Weber performed in GG Allin's final backing band The Murder Junkies, playing the electric guitar.
Weber performed on the sole GG Allin and the Murder Junkies studio album Brutality and Bloodshed for All.
Following GG's untimely death, Weber performed in a continuation of the Murder Junkies, who eventually released a 10" mini-album (later re-released in an extended version on CD) entitled Feed My Sleaze.
Ramone left the band before he even played a live show (although a recording session, featuring both he and a newly released GG, is preserved on film); the remainder of the band composed music for their forthcoming set - later to form the Brutality and Bloodshed for All album, whilst GG composed the lyrics from his prison cell without previously hearing the music.
Weber has also made records, videos and films with the Chrome Cranks, The Candy Snatchers, The Tigerlilies, Sugarshock, The Brass Knuckle Boys, Human Zoo and as dumBASS.