Jimmy Rogers has acknowledged that "That's All Right" draws on ideas from other bluesmen, including Robert Junior Lockwood and Willie Love.

[3] Lockwood had performed it years earlier in Helena, Arkansas,[4] which Muddy Waters confirmed: "'That's All Right', that Robert Jr.'s song", he added.

[3] Little Walter on harmonica accompanies Brown on vocal and guitar and some pressings of the Chance single are titled "That's Alright" and credited to "Little Water J."

It features Rogers' guitar and plaintive vocals, with Little Walter playing in the style of Sonny Boy Williamson I.

[5] In the inductee announcement, the Foundation called it a "poignant reflection sung in Rogers’ characteristically warm and empathetic style, with Little Walter's sensitive support on harmonica".