[6][7] The album marked Tom Herman's return to Pere Ubu's studio work after a twenty-year absence.

"[11] The Chicago Tribune determined that "though a little less hook-oriented than its predecessor, Pennsylvania finds the band cloaking David Thomas' delirious visions of America in a claustrophobic yet compelling cubist blues-rock that could have emanated from no other band in the world.

"[12] Stereo Review opined that "the acoustic/slide-guitar mix in 'SAD.TXT' is downright Zeppelinesque, and in 'Woolie Bullie' ... Ubu locks into a monolithic, pounding riff that may be the dumbest thing these folks have ever played, and it sounds great.

"[13] Reviewing a 2021 remix of the album, Record Collector wrote that Herman's "presence is dynamic from the chugging chords of opener 'Woolie Bullie' (most definitely not the old rock’n’roll song) through 'Muddy Waters' (certainly not blues) creating high-energy fragments of nearly-pop.

"[5] In 2005, to celebrate Pere Ubu's 30th Anniversary, a "Director's Cut" was released which featured new mastering, alternate mixes, and two bonus tracks.