The Guardian described their early work as "defined by aggressive, guitar-driven noise, which was matched in spirit by Standish’s haunted, brazenly sexual lyrics.

"[2] Pitchfork noted how since Stewart's death, the band "shed the cold, industrial leanings of their earlier releases for a more overtly sensual approach, something that could soundtrack moments of intimacy or ennui, or both.

"[3] Originating from Melbourne, and previously based in Berlin and London, HTRK (pronounced Hate Rock) started playing in November 2003 when guitarist Nigel Yang and bassist Sean Stewart invited vocalist Jonnine Standish to create music inspired by the surrealistic films of David Lynch, along with protopunk and post-industrial ideas.

Using a very slow 808 drum machine, minimal bass grooves and highly textured noise, their attitude clashed with the "rock and roll" status quo in Australia.

Titled Marry Me Tonight and considered something of a pop effort by the band, the album was held in limbo for several years due to a protracted rights dispute.

In August 2005, the band performed as a support act for Howard at the premiere party for Scott Crary's film, Kill Your Idols, in Melbourne.

[5] In 2006, a few months after recording Marry Me Tonight, the trio relocated to Berlin, toured with fellow expatriates Devastations and played their first UK gig at the 20jazzfunkgreats club in Brighton.

Upon witnessing a show at the Brixton Windmill, UK label Fire Records signed HTRK to give Nostalgia a wider international release.

Their increased profile led to a headline show at Cargo in London in January 2010, which coincided with the release of the first of a series of free mixtapes[8] and appearances in US magazines Alternative Press and Nylon.