[7] Fletcher described the song's composition, writing: "'Just a Little Bit' takes a laid-back jazz beat, some funked-up guitar twangs, and the sort of easy listening rhythm that TLC and En Vogue used to toss about willy-nilly 15 years ago.

While it's splendid to hear Buena deliver her delicious dulcet tones without Groove Armada sticking their oars in, there is more than a faint whiff of '90s nostalgia about the tune.

[8] The New Zealand Herald critic Rebecca Barry Hill praised Buena's vocal performance on the song, which she characterised as "bluesy".

[10] Alex Fletcher from Digital Spy gave the song a three out of five star rating and wrote, "It lacks that killer pop hook to make it anything more than a decent album track".

[11] Mickey McMonagle from the Sunday Mail commended Buena's vocal delivery, but admitted that the song is "slightly lacklustre at times" despite being a decent track.

The Observer critic Kitty Empire wrote that during the performance, the track "plays its old soul cards nicely", and that Buena's sound was evocative of English singer Gabrielle's.