Pitchfork reviewer Jason Heller said that "Gremlins provides a candid peek under Erickson’s hood during his most potent years as a solo artist.

He particularly praised the acoustic songs, especially "I’m a Demon," which he called "an eternal, elemental performance, a roughhewn mass of outsider self-exorcism that echoes alongside Hasil Adkins, Syd Barrett, Jonathan Richman, Daniel Johnston, and Alex Chilton.

"[3] Austin Chronicle writer Scott Schinder called Erickson's 1980s albums, released after his half-decade involuntary stay in a Texas psychiatric hospital, "the clearest glimpse into his raging musical soul."

He described Gremlins Have Pictures as "in some ways the most compelling" album of this era, "a stylistic and chronological scattering of live tracks, alternate versions, and stray songs (that) offers a vivid, unvarnished account of Roky Erickson's singular talent and vision.

"[5] Jason Ankeny of AllMusic was less positive, saying that of the three backing bands, "only the Explosives are remotely competent, although Roky himself is surprisingly together."