[3] Fine Lines, the band's debut EP was released in March 2004 and was co-produced by Peter Katis (The National, Interpol, Mercury Rev), as was their first full-length album, Tree City, with additional production from Britt Myers (Dressy Bessy, Chairlift).

In the summer of 2006 the band parted ways with drummer Tomer Danan and went in the studio as a trio with Trokan taking over drumming duties to record their follow up LP, Grand Animals.

For this album the band connected with Italian film composer Daniele Luppi, known mostly for his string arrangements and orchestral work with Danger Mouse (Gnarls Barkley, Broken Bells) and pop artists like John Legend.

After an extended rest, Robbers on High Street returned to form in 2008 - playing shows (sometimes as Electric Light Orchestra), writing new songs and recording several covers - Emitt Rhodes, The Style Council, and even New Edition - for various compilation releases.

In June 2010, the 7" single Electric Eye b/w Face In The Fog, two tracks from the yet unreleased upcoming album tentatively titled Hey There Golden Hair, was released on Engine Room Recordings.