By Night is the debut recording of New Zealand indie rock group The Bats, released in 1984.

However, the track "My Way," from this EP, was omitted.

It was added in the 2010 remastered reissue of the CD.

Trouser Press called it "paradoxically morose and exhilarating; each song a moody pop gem, with hints of the hard-strummed countryisms of Gram Parsons.

"[5] PopMatters wrote that it balances "pop grace and idiosyncrasy.