Johnny Loftus of AllMusic granted Welfare Problems 4 out of 5 stars, stating that the album "finds Randy's ideology undiluted by the addition of buzzing guitar hooks and shoutable choruses to its punk rock roots."

"[2] Loftus cites "A Man in Uniform," "X-Ray Eyes," "Welfare Problems," and "Dirty and Cheap" as the standout tracks.

[2] In his review of the album, Chris O'Toole of The Bedlam Society rewarded the album 8.5 out of 10 stars, favorably comparing Randy to other bands that were part of "the recent garage influenced Rock N' Roll revival," including fellow Swedish bands The Hives, Refused, and The (International) Noise Conspiracy.

While pointing out that several of the songs on the album have more "reflective" and "personal" subject matter than others, he says, "one of the most endearing qualities of this Swedish quartet is that they are not afraid to showcase their quirky and fun side along with the harsh reality of their [sociopolitical] concerns."

O'Toole cites "Cheap Thrills" and "X-Ray Eyes" as stand-out tracks, calling the latter "[a rival] and [...] certainly on par with "Hey Ya!"