He is the lead singer and rhythm guitarist of The Music, in which he is recognisable for his distinct high-pitched vocals and Northern soul-inspired on-stage dancing.

Harvey formed The Music with close friends Adam Nutter, Stuart Coleman and Phil Jordan in 2001.

The band toured with New Order, The Charlatans and Oasis, as well as selling out Blackpool Empress Ballroom and London's Brixton Academy.

Mike Skinner asked Harvey to join him on tour as the guitarist/singer which saw The Streets headline shows and festivals across the UK and Europe.

On 27 September 2021, it was reported by the Daily Mirror that Harvey would be joining Kasabian for their forthcoming tour, following the departure of former frontman Tom Meighan in 2020.