[1] The month after, it was announced that the artist would be releasing a greatest hits album, titled Ultimate Kylie, containing two new tracks,[2] being "I Believe in You" and "Giving You Up";[3] Jake Shears and Babydaddy were in charge of the production of the former, whilst the latter was produced by Brian Higgins and Xenomania.

Written and recorded for Ultimate Kylie during the summer of 2004 in London,[9] the song takes its inspiration from disco and 80s new wave electropop music,[10] and has been described as similar to 80s-era New Order.

The refrain features Minogue singing a high octave chorus with strings and a thumping beat in the background.

[13] Joey Rivaldo, in a review for About.com, said the song was "perfect for radio" and praised it for its "nice laid back pop sound."

[7] In another review for About.com, Jason Shawahn called the song "one of the finest eurodisco confections to come down the pike since the glory days".

[8] Virgin.net called the song a "rather demure and stylish collaboration" with Jake Shears and Babbydaddy, and said that "while it may all lack any really enticing hooks (or particularly interesting lyrics), it's still quite an enchanting record" due to its "pulsing analogue bassline and kick drum combo.

[22][23] The premise of the futuristic video involved Minogue performing different scenarios within a studio filled with colourful neon lights.

[9] The clip opens with Minogue standing in the centre of a large "sphere" enclosed by neon lights as it revolves around her.

Upon reaching the second verse, a new sphere, with a new set of lights, is added around Minogue, as she wears a new costume and glitter around her eyes.

[24] The video progresses to Minogue dancing before a psychedelic flash of swirling colours, before resolving to a black background lit up by a troupe of dancers wearing "glow effects".

[24] It was revealed that these multi-coloured light bulbs were actually attached to the bodies of the dancers, who had to carry their power sources around in makeshift "shopping" bags for the duration of the shoot.

Costumes for the video were designed by Dolce & Gabbana, and consisted of a series of dresses which Minogue described as "floaty",[23] including a dress of purple silk chiffon with gold mesh fabric bra-top and girdle, worn with gold metallic shoes made by Chloé.

[25][26] The complete version of "I Believe in You" featured in the music video has been released commercially through CD singles and digital downloads, and some include remixes by Mylo and Skylark.

About.com stated that the remix provides the song with an "electro trip", commenting that it is "the perfect mix for all the Mixshow DJs out there.

A radically different version of the song was crafted in 2007 for The Kylie Show, a one-off television program that aired on UK's ITV on 10 November 2007 as a marketing vehicle for her tenth studio album X.

[28] In order to promote Ultimate Kylie and the single, Minogue performed "I Believe in You" in shows such as Top of the Pops,[29] Nordic Music Awards,[30] Top of the Pops Saturday,[31] Premios Ondas,[32] Star Academy,[33] Hit Machine,[34] Today with Des and Mel,[35] and Wetten, dass..?.

This song was performed as part of all four set orders in the act entitled "Starry Nights" (or "Beach Party" in the case of one leg).

[41] Minogue also performed the song as a ballad on Star Academy with Quentin Mosimann,[42] and The Kylie Show TV special.

In 2014, the version of "I Believe In You" from Minogue's album The Abbey Road Sessions was used in a television advertisement for the British building society Nationwide.