[2] Gordon later presented a demo version to Ralph Bass at King Records, who was reportedly uninterested in the song.

[2] The Tiny Topsy song, featuring a pop-style arrangement with background singers and flute, did not reach the record charts.

An early review described the song as "a rhymba [rhumba] blues",[5] a reference to Gordon's "slightly shambolic, loping style of piano shuffle called 'Rosco's Rhythm'".

[7] "Just a Little Bit" was Rosco Gordon's fourth (and last) single to enter the R&B chart, where it reached number two during a stay of seventeen weeks in 1960.

[11] According to music writer Steve Turner, the opening horn line of the original Roscoe Gordon version influenced Paul McCartney during the writing of the 1968 Beatles song "Birthday".