[2] He was a key figure in keeping the group together after Stein and Harry considered disbanding, following the departure of original bassist Fred Smith to Television; Burke recruited his friend Gary Valentine to play bass.

He went on to record with the line-up of Chequered Past in 1983 with Sex Pistols guitarist Steve Jones, former Blondie bandmate Nigel Harrison, musician Tony Sales and singer/actor Michael Des Barres.

[14] In 2007, Burke joined Slinky Vagabond with David Bowie guitarist Earl Slick, Glen Matlock, and Keanan Duffty playing their debut concert at the Joey Ramone Birthday Bash in May 2007.

[19] In December 2011 he formed the band the International Swingers with Sex Pistols bass player Glen Matlock, guitarist James Stevenson of Generation X and singer Gary Twinn of Supernaut.

In April 2013, Burke appeared on the Little Steven song "All I Needed Was You" along with Scott Kempner, Barry Goldberg, Gregg Sutton and Tom Jr Morgan on the Carla Olson album Have Harmony, Will Travel.

[26] In December 2021, Burke filled in on drums for Gina Schock during the Go-Go's show at the Whisky a Go Go to celebrate their recent induction into the Rock and Roll Hall of Fame.