The band were then asked to be the national opening act for Franz Ferdinand's sold out Australian tour, before releasing their debut self-titled EP.

The lead track, Tune In/Tune Out, would gain regular air play on JJJ, FBi, ZzZ, RAR and other community radio networks.

After signing with the Sydney-based label Ivy League, the band would release their second EP, The Plan A, in October 2005, and would embark on a national tour with Faker, taking them to larger stages and introducing them to new audiences.

The tour would take the Red Riders extensively across Australia, before seeing them close the year with a set headlining the Hopetoun Stage at the Homebake festival.

The album received extensive air play on national youth radio station Triple J while the first single 'Slide in Next To Me' was voted in at number 96 in the 2006 Hottest 100.

2007 would see the band play the Big Day Out again, along with a national tour with Dappled Cities, and also begin planning for a new album, which would eventually become Drown in Colour.

After completing the Drown in Colour tour in early 2010, the band took time off, with Brad Heald rejoining The Vines for numerous shows.

Grigg and Wallace would go on to form the garage rock band Palms; while Heald went on to play with groups such as Dune Rats, The Walking Who and Dope Lemon.