Over the next two years, they were involved in the live music scene in Christchurch and Dunedin, before releasing their first EP, By Night (1984), on the nascent alternative New Zealand record label, Flying Nun.

The band's early releases were accompanied by some typically low budget but original music videos, notably 'By Night', 'I Go Wild' and 'Downfall'.

[3][4] The band then travelled to Europe and spent time touring Britain and Germany, including playing support for Alex Chilton.

'Made Up in Blue', the first single released in the U.K. by Flying Nun,[5] was awarded 'Single of the Week' by the influential British magazine, NME.

"[9] In September 2005, The Bats released their first album in ten years, At the National Grid, on their own label, Pocket Music.

Tim Sendra at Allmusic gave it 4 stars, adding "...having the group back at such a high level is as refreshing as a plunge into an ice-cold mountain stream.

[7] The Bats' seventh full-length album, The Guilty Office, was recorded in Heathcote Valley, Christchurch, and was released on 1 December 2008 through Arch Hill.,[5] with the first single, 'Castle Lights'.

International release followed, on YesBoyIcecream in the UK and Europe, Kning Disk in Scandinavia, Hidden Agenda in the US, and Mistletone in Australia.The Guilty Office was named in the top 5 of 2008 by New Zealand television host, John Campbell, and received many positive reviews including 4 stars from Allmusic and Mojo Magazine.

[12] In October 2010, the band played at the free relief concert in Hagley Park following the September 2010 Canterbury earthquake in front of about 140,000 people.

[13][14] In 2011, The Bats reunited with their old label Flying Nun and released their eighth album, Free All the Monsters, which was described by Pitchfork as "...their best record in years, possibly ever".