Jason Lipshutz of Billboard magazine wrote: "Consisting of three movements between calm, ethereal verses and an assault of synthesizers and programmed drums on the refrain, "Plague" obscures Glass' lyrics as her voice tries to overpower an avalanche of noise.

"[2] Tom Breihan of Stereogum called the song "their [Crystal Castles'] latest bit of bloodthirsty gothed-out dance music," while stating that "it will doubtless sound amazing the next time you see them in some dank cavern of a venue.

"[5] Jamie Fullerton of NME noted "the ominous thump and nasty bass, plus eerie silences that act like post-apocalyptic drops", also further commenting that the band still sounds "dangerous, demented and utterly thrilling" with their new song.

[6] In his elaborative track review, Dean Lucas of This Is Fake DIY called the song an "almost a modern day interpretation of the 'O Fortuna' movement of Carl Orff's 'Carmina Burana' as the drama builds thanks to an ominous-sounding beginning to a frighteningly huge catharsis."

He also described Alice Glass' vocals as "sounding like a threat of suicide thanks to her petulant psycho-brat charm," while writing that "quieter build-up to its gothic chorus drenched in black keys is both immediately oppressive and haunting."