Throughout their history, the group had numerous bass players; Charlie Luciano (original line-up), then Crabtree, Dave Harris (1991), Lenie Mets (1991–93), Anthony Coote (1993-6) and Terry De Castro (2000–01).
This, along with their third single, "50 Dresses" - a 10" vinyl-only EP - helped the band come to wider attention as the group won critical acclaim for their mixture of "slice of life" lyrics and magic realism, and their distinctive use of the trumpet as a lead instrument.
In 1999, a demo, "Dirt", was featured on a various artists EP on the independent Snowstorm label, which subsequently commissioned a third Animals That Swim album, some of which was recorded in producer Dare Mason's home.
In 2007 frontman and lead singer Hank Starrs – now a film producer and writer — made a brief comeback to guest on the single "Direct Hit" with English art-pop group Art Brut.
In 2009, former Animals That Swim and Goya Dress bassist Terry De Castro (better known as a member of Cinerama and The Wedding Present) released a cover version of the group's song "East St. O'Neill" on her solo album A Casa Verde.