Originally released as a B-side for Lovich's cover of "I Think We're Alone Now", the song was re-released in 1979 by Stiff Records as an A-side and became the lead single of her debut studio album Stateless (1978).

The German version "Wir leben immer... noch" ("We are alive... still") was released on the album Unbehagen (1979).

He immediately proposed the song to be released as a single and wanted Lovich and Les Chappell to write and record a B-side.

According to Lovich, she "didn't know anything about writing a song, so [the producer] just threw together a vocal line that sounded like a synthesizer.

"[citation needed] The chorus, coupled with a guitar ostinato and rapid vocal shouts from backup singers, gave the song and Lovich a sound that would define her next several records and, according to Rovi, "the hundreds of bands that followed.