The song samples 2 Unlimited's "Get Ready for This" written by Phil Wilde, Jean-Paul de Coster and Ray Slijngaard.

Minogue then created the alias "Angel K" for herself and released white label promotional vinyls of techno tracks including "Do You Dare" and "Closer"; both of the songs later appeared as B-sides on "Give Me Just a Little More Time and "Finer Feelings", respectively.

[3] Nathan Wood from Foxtel's MaxTV called the song "surprising" and claimed it "signaled Kylie's change from a pop princess to an artist with diverse, genre-pushing tastes, and paved the way for her extensive exploration into the world of dance music that would come later.

"[1] However, Chris True from AllMusic criticised the stadium keyboard part that lays the foundation of the song, calling it one of album's "noticeable missteps".

On the back cover of the CD single, The Visionmasters were said to be "a concept born out of visions at Angels Burnley," a nightclub where Taylor held a residency at throughout the 1990s, and originated his Retro club night there.