After a series of successful EP releases in 2000–2002, in 2003 they recorded their first studio album Tough Guys Don't Dance.

[4] Other prominent musicians such as Mike Patton (of Faith No More, Mr. Bungle, Tomahawk and other projects), Jason Pierce (of Spiritualized and Spacemen 3), Richard Hawley, and Gibby Haynes (of Butthole Surfers) also feature on the album.

The non-album single "Sunrise", a song written by Lanegan and sung by Will Oldham, preceded the album release on 3 August 2009.

The B-side is a cover of Palace Brothers' "You Will Miss Me When I Burn", a song written by Oldham and sung by Lanegan, that is also featured on the Broken album.

The pair have also worked as film score composers, such as on BattleGround: 21 Days on the Empire's Edge produced by the Guerrilla News Network.

The idea of collaboration between band members and Depeche Mode vocalist Dave Gahan was embodied in the 2012 album The Light the Dead See, consisting of ten songs and two instrumental tracks.