Later that year, he was asked to join post-punk band Gene Loves Jezebel when their guitarist left suddenly at the beginning of their first U.S. tour.

Stevenson performed on the band's albums Discover, House of Dolls, Kiss of Life, Heavenly Bodies, VII, The Thornfield Sessions, Dance Underwater (2017) and Love Death Sorrow (2023).

He has contributed as a session guitarist on numerous recordings including artists as diverse as Scott Walker (the Drift and Bish Bosch), Henry Badowski (who he was at Chiswick Community School with), Charlie Harper of the UK Subs, Duncan "Kid" Reid of The Boys, Jimmy Nail, Helen Terry, Annabel Lamb, Louise, Jonathan Perkins and the Hothouse Flowers among others, and has composed music for TV and film.

He has played on all Alarm albums recorded since 2000 including In the Poppyfields, Under Attack, Counter Attack, Direct Action, Guerilla Tactics, Blood Red, Viral Black, Equals, Sigma, War and Forwards Stevenson still plays with the Alarm and Gene Loves Jezebel (Jay Aston's version).

[14][15] Via PledgeMusic, the band raised the money to record their first full-length album, The International Swingers (mixed by Peter Walsh), which was released in 2015.

[20] In the spring of 2017, Gene Loves Jezebel (Jay Aston's version) released their first studio album in 14 years on Westworld Recordings, Dance Underwater.

On 9 July 2021, Stevenson released his second solo album The Other Side of the World, dedicated to his younger brother David and his fight against the terminal illness Pick's disease.

In his review of Love Death Sorrow for Goldmine Magazine, Dave Thompson wrote "guitarist Stevenson is simply blazing.