In a review for Blogcritics, Tan The Man wrote that the song is "mesmerizing, evoking a sensual striptease fantasy by a former love" and that it "fuses so many sounds, from quasi-bossa nova to soul, while maintaining a simplistic and raw, non-explicitly erotic beat in the background.

"[6] Matthew Perpetua from Spin rated the track seven out of ten, stating it is "built upon the clack and clang of acoustic percussion and little else, aside from occasional bits of guitar or saxophone", addind that it sounds "exceptionally intimate, to the point where it's easy to feel voyeuristic when listening on the title cut to her unguarded declaration of love.

"[9] Adrien Begrand of PopMatters felt that the song's "approach is far more subtle than most contemporary pop singles would ever dare to be, its gentle, slightly distorted bass synth propelled by the faintest traces of percussion, both electronic and acoustic, Yttling providing mandolin accents during the choruses.

But it's Lykke Li who commands our attention, delivering as perfect a hook in the chorus that rivals Robyn's best work, but not before making us fall off our chairs with a second verse that tosses aside all nuance in favor of direct, unadulterated lust.

"[10] Rolling Stone's Will Hermes opined that "[a] quietly intoxicating electropulse drives the reluctant lover's confession in 'Little Bit' while Li memorably rhymes 'legs apart' with 'tainted heart.