"Skinny Minnie" was a Top 40 hit by Bill Haley & His Comets in 1958, while "Justine", also from 1958, was written and originally recorded by the duo Don and Dewey and was a staple for the Righteous Brothers beginning in the mid-1960s.

[3] After recording Never Been Caught, the Mummies played many shows on the West Coast of the United States and toured Washington and Canada with Thee Headcoats.

[3][4] After a brief tour of the East Coast with performances in New York, Washington, D.C., and New Jersey, they returned to San Francisco in early January 1992 and broke up, shortly before the album's release on Telstar Records.

[8] In 2002, after the Mummies had been inactive for eight years, Telstar re-released the album on compact disc for its tenth anniversary, adding five additional tracks.

[5] Shane White wrote updated liner notes for this release, explaining why the Mummies had finally consented to a CD release of their material: "Happy to give back whatever stupid punk rock credibility anyone had ever given them (and that wasn't much), they gave ol' Telstar the okay to re-issue their one and only legitimate long player onto the now dated CD format.

"[5] Writing for AllMusic, reviewer Mark Deming called the album "one of the most gloriously ugly garage albums ever [...] Sounding like it was recorded in an acoustically untreated basement on equipment that might have been state of the art in 1947, Never Been Caught is one long blast of monophonic skwak, with the needles almost perpetually in the red as four guys in mummy outfits bash out crude '60s-style rock about beer, babes, and open hostility on battered gear which was doubtless discarded by tone-deaf teenagers who got over their 15-minute delusion of possible future rock stardom in 1966.

In case you haven't figured it out by now, this album is, quite simply, a work of genius [...] a perfect reminder that once upon a time rock & roll was considered dangerous just for being fast, loud, and snotty".