[1] According to member Ethan Kath, the track was inspired by a suicide at the Celestica factories in Canada, where a worker reportedly jumped into a vat of hot plastic, which was then rumored to be still used in manufacturing products.

[4] Larry Fitzmaurice of Pitchfork compared it to Crystal Castles' "Courtship Dating" (2008), but with its "buzzy, brain-addling riff" replaced with "stadium-sized synths and a throbbing house heart".

[8] Multiple reviewers highlighted the melody of "Celestica"; Rebecca Schiller of NME described it as "sweepingly melodic", with Crystal Castles "embracing simple, calm beauty".

[3] Eric Torres wrote to Pitchfork that the track combines member Alice Glass' "gorgeous melody" with Kath's "cavernous synths and scraping guitars".

[9] The Guardian's Michael Hann compared "Celestica" to "those swooning, melancholy European faux-classical melodies" of Pet Shop Boys and described it as the most pop-centric of the Crystal Castles album.

[10] Regarding Glass' vocals on "Celestica", Los Angeles Times writer August Brown described them as a delicate alto reminiscent of Hope Sandoval,[11] while Emily Mackay of NME compared her soft singing to the one in Delerium's "Silence".

[5] Molly Beauchemin of the same website described it as an "excellent counterpart" to "Doe Deer", which follows "Celestica" on the Crystal Castles album, while also considering it a "gorgeous, harmonious classic".