"[2] After adding bassist Robert Pyne, who Joel knew from school, and drummer Grant Marsh, who Luke met in the Candy Box club, the Rifles performed their first gig at The Bull & Gate pub in Kentish Town, London in 2004.

The band switched to fellow independent label Xtra Mile Recordings for their May 2005 release of the single "When I'm Alone", which would go on to reach number 64 in the UK charts.

The band toured in 2006, and performed at A Campingflight to Lowlands Paradise 2007 and Paaspop Schijndel 2007, two music festivals in the Netherlands.

The Rifles launched their European tour to promote their new album including a gig at the Forum, London, at which Paul Weller (The Jam) appeared on stage to play the song "She's the Only One" with the band, and The Jam's single, "The Eton Rifles".

Touring on the back of their album No Love Lost, The Rifles again released a free download, this time of their single "Talking" on 20 October 2007.

The single garnered high accolades from BBC Radio 1's Zane Lowe, who called it the "Hottest Record in the World".

The Rifles also made appearances at the Underage Festival and the V Festival in the summer and played an extensive tour throughout October and November in 2008 when long-time friend of the band Dean Mumford (from the band Regency) was added on keyboards as session player for live performances.

Long time friends Lee Burgess and Kenton Shinn from the band Garda were added to the Rifles.

[11] In addition to a deluxe Freedom Run, the Rifles had an autumn/winter acoustic tour in 2012 and started work on songs for a new album.

[14] In May 2013, the band announced that the four original members, including Marsh and Pyne, had reunited and were working on a fourth album.

The album features versions of their songs taken from None The Wiser, Great Escape, Freedom Run, No Love Lost and Big Life.