Musically, the songs on Punkhouse are in a similar vein to the band's previous album Boogadaboogadaboogada!, albeit with a rougher sound.

The EP went out of print quickly, and vocalist Ben Weasel repressed it himself on his own label No Budget Records in 1991 without a jacket.

The song "Fathead" was later re-recorded for the group's third album My Brain Hurts in 1991 and all the original tracks from the EP were included on the compilation Kill the Musicians in 1995.

[1] Tensions grew within Screeching Weasel at the last show of the tour and, two weeks later, bassist Warren Fish left the band.

The entire EP was recorded without John Jughead's guitar, due to him being stranded in downstate Illinois.