[4] The song's music video was directed by Tim Pope and produced by Lisa Bryer for MGMM Studios.

It was shot at Bell Studios in London and features Hollis sitting with his guitar and singing the lyrics.

"[4] He added to International Musician and Recording World, "That song means so much to me that to sit there and mime to it just feels totally stupid.

"[3] Upon its release as a single, Peter Kane of Sounds felt that "I Believe in You" "makes for a genuinely moody and queer little 45".

[6] Andrew Hirst of the Huddersfield Daily Examiner praised it as a "ponderous, deeply atmospheric ballad", but also believed it had limited commercial appeal by commenting, "The band has drifted an age away from its original pop leanings and this dulcet delight is far too profound to grab a slice of the commercial cake.

"[7] Caren Myers of Melody Maker described the song as "broody" and added, "This just kind of floats right through you, as the synths and the voice compete to see who can sound more evanescent and soothing.

He commented, "A band who crawl out of dank, sleepy hollows to record what they call 'artistic masterpieces'.