Written by vocalist Oliver Sykes, guitarist Lee Malia and keyboardist Jordan Fish, it was produced by Terry Date and featured on the band's 2013 fourth studio album Sempiternal.

[4] The writing and recording process for "Go to Hell, for Heaven's Sake" was slightly different to the normal approach adopted by Bring Me the Horizon – speaking to Sugarscape.com, bassist Matt Kean recalled that "for this one, instead of going into a room to jam and play the songs we would pre-record riffs or keyboard parts ... then if there was a good part we'd record it on the computer directly".

[9][10] The video depicts the band performing in a chapel alongside imagery intended to illustrate the song's lyrics, including "empty swings swaying back and forth, a pin piercing a voodoo doll, religious symbols, and a raven sitting on a tree branch".

[11] Dean Brown of PopMatters compared the style of "Go to Hell, for Heaven's Sake" to that of Linkin Park, praising the band for "rejuvenat[ing] the stale dynamic for the year 2013".

[13] Loudwire ranked it the eighth best Bring Me the Horizon song in May 2014, hailing it as "a faultless representation of how the band has evolved over the past decade".