Haller played with Wayne County & the Electric Chairs, The Flying Lizards, The Lords of the New Church, Paint and Savage Republic.
[2] In 1975, Haller moved to London and formed the Rockets, recruiting guitarist Andy Colquhoun later of the Pink Fairies.
The band performed the song "Paranoia Paradise" in the movie Jubilee, produced by Derek Jarman.
The three former Electric Chairs then formed a new group, the Mystere Five's, with vocalist/guitarist Chris Reeves and non-musician Marc "Frenchy" Gloder.
Haller contributed synthesizer to the Flying Padovanis debut single "Western Pasta" / "Vas Plus Haut", released in 1981 and formed Paint with vocalist Jonathan Hughston.
[6] On his return he joined Johnson in The Flying Lizards, playing bass on two songs on the 1981 Fourth Wall album, "In My Lifetime" and "A Train".
An EP Siam was released, followed by an album 1938 and the band toured widely including the North East United States, Italy, Germany, Belgium, Poland and Greece.