According to Songfacts, Morrison wrote the mid-tempo ballad about Gill, his long-term girlfriend and the mother of his daughter.

Robert Copsey of Digital Spy gave the song an average review stating: ""Take a little time to hold yourself/ Take a little time to feel around," he insists in his unmistakable gruff tones, before the lilting guitars and gentle piano riff shift gear for the swaying, '60s slow-dance chorus.

"[2] Jon O'Brien wrote for AllMusic that ""I Won't Let You Go" follows the same heartfelt, acoustic, tearjerker template as his previous two lead singles;.

"[3] Pip Elwood wrote a positive review for "Entertainment Focus", stating that "The album’s lead single is a progression from Morrison’s usual sound.

In April 2012, Daniel Evans, a finalist on The X Factor UK released an acoustic version on his YouTube channel.