Reviewing the Dimensions EP for AllMusic, Thom Jurek outlined that the song contains "Over stomping, fuzz-thudding Geezer Butler-style bass", as well as comparing Andrew Stockdale's vocals to those of Sabbath and Zeppelin frontmen Ozzy Osbourne and Robert Plant.

[2] Drowned in Sound writer Jordan Dowling claimed that "several nods" are given to Sabbath guitarist Tony Iommi on the track,[8] Kerry McGregor of the fanzine Burnout identified a "Black Sabbath-esque stomp",[3] and Blabbermouth.net's Keith Bergman suggested that it features "some early Ozzy warbling".

[8] In a review of Wolfmother for the NME, James Jam suggested that the song "tick[s] the requisite boxes for all great rock'n'roll – raucous, righteous and totally, thrillingly dumb".

[16] PopMatters writer Adrian Begrand outlined that the track "sounds like uninspired garage rock at first, but quickly kicks into gear a grooving riff, and then downshifts into an ear-splitting breakdown".

[17] AllMusic's Thom Jurek, however, was damning of "Dimension", criticising it as "mucky, dirty, and saturated in the very 'eavy rock clichés of yore", and calling the song's lyrics "just plain bad".