Kele Okereke, lead singer and rhythm guitarist of the indie rock band Bloc Party is featured on vocals.

[3] John Bush from AllMusic described: "[The song] agonizing over an energized electroshock production composed of equal parts Prince and Chicago acid house.

"[4] Thump, "an electronic music and culture channel" from Vice, listed the song as one of the duo's 15 best collaborations, ranked at number 12.

[5] Rolling Stone's Bill Werde wrote that "the urgent yelp of Kele Okereke from Bloc Party makes 'Believe' a club-anthem-in-waiting.

The music video for the song was directed by Dom and Nic, contains scenes filmed at the now defunct MG Rover Longbridge plant (now owned by SAIC) and different parts of London.