Billy Hill's version of "I Can't Help Myself (Sugar Pie Honey Bunch)" made an appearance in the 1990 film My Blue Heaven.

The Chicago Tribune deemed I Am Just a Rebel a "rollicking album," writing that "Billy Hill delivers heat, humor and heart.

"[6] The Advocate wrote: "Imagine Levon Helm getting together with Little Feat to play some hillbilly music and you have some idea of what Billy Hill sounds like ...

"[7] The Buffalo News concluded that Billy Hill "have a big, fun, 'bloozy' sound that is heavy on slide guitar, somewhat similar to the Rolling Stones' occasional forays into country.

"[8] The Orange County Register stated that the "music is down and dirty, R&B-influenced barroom country rock with a ballad or two thrown in for good measure.