While the Smiths provided Joyce with his first taste of success, he had previously drummed for Manchester band The Hoax and Northern Irish punk rock group Victim.

[2] They, along with Craig Gannon, also provided the rhythm section for two singles by Smiths' singer Morrissey – "Interesting Drug" and "The Last of the Famous International Playboys" and their B-sides.

Joyce, Rourke, and Gannon reunited to work on a project with fellow Manchester musician Aziz Ibrahim (formerly of the Stone Roses and Simply Red), ex-Oasis guitarist Bonehead (as Moondog One), and Vinny Peculiar.

[17] Joyce was born in Manchester to Irish Catholic parents, and attended St Gregory's Grammar School in the city.

[21][22] In 1996, Joyce sued former Smiths' colleagues Johnny Marr and Morrissey for an equal share of performance and recording royalties.