The band currently consists of Austin Williams (vocals), Cavan McCarthy (bass), James Balmont (keyboards), Robbie Wood (guitar), and Thomas Fiquet (drums).

On the subject, Austin said, "We thought it was a long shot but we’d just lost another drummer so we asked Zach if he wanted to join our band, that was one of the best things that happened, to be honest.

After a UK tour with Spector in November and December 2012, the band went to Brussels to record their debut album with producer Charlie Hugall.

NME's review of "Honey" said that "the best bits of the Birmingham mob’s latest cut have the pull of a star-spangled whirlpool that’ll suck you back into the late ’80s.

The Guardian's Michael Hann commented that "Where the Heaven Are We is a pleasant wander through the byways of early-90s indie styles that doesn't ever really assert itself terribly strongly".

[14] NME's Barry Nicolson said, "the dreamy, detached sneer of the vocals, the lolloping XXL basslines, all that unwashed hair… Some scenes come roaring out of the traps; B-Town seemed to roll out of bed, insular and uncontrived, smirking at its own in-jokes".

"To My Brother" was noted by critics for its marked change in direction, with many picking up on the unexpected influence of acid house music.

[16][17] Speaking to DIY Magazine, Austin addressed the band's dramatic new direction: "I feel like we’re all shaving our heads and going to war with this record.

Captioning a photograph of a new-look Swim Deep on the beach, they said: "We’re off to a studio by the sea to finally finish the album we’ve been dreaming of our whole lives and we’re so ready to share it with you."

They played their first show of the year in Jakarta, Indonesia in September 2018, performing two new songs titled "To Feel Good" and "Sail Away, Say Goodbye".

They performed their first gig in the UK at Dalston venue Birthdays on 12 September 2018, and later headlined Academy 2 Manchester as part of Neighbourhood Festival.

[27] The EP contains five tracks that featured other artists, Australian singer-songwriter Hatchie and Thai pop duo Dept, as well as Williams' fiancée, Nell Power.

[36][37] Nevertheless, the band transitioned to a psychedelic pop sound on their second album, Mothers, informed by acid house, Balearic beat, gospel music and Motorik rhythms.