The band then recorded their second album, Burning Your House Down, which was produced by Jim Sclavunos of Nick Cave and the Bad Seeds and Grinderman.

In interview Jim Jones has explained that they also chose Sclavunos for his work with bands like Sonic Youth and The Cramps.

On 2 September 2010, the band previewed Burning Your House Down at London nightclub Madame Jojo's in front of a sold-out audience, which included Oasis singer Liam Gallagher as well as members of Grinderman and Nick Cave and the Bad Seeds.

The band pianist, Henri Herbert, put on an impromptu performance on a public piano at St. Pancras International train station, London.

[5][6] The BBC's Johnny Sharp wrote that the band's "string-shredding guitar, furiously chattering piano and blistering, blustery rhythm" meant that "you’re bombarded with sonic viscera".