[1] Like several other songs from Dad Loves His Work, "Hard Times" was influenced by the impending breakup of Taylor's marriage to Carly Simon.

"[7] The lyrics describe the difficulty for an "angry man" and a "hungry woman" to stay together, and hope that the couple can stop "driving each other crazy.

[5] Allmusic critic William Ruhlmann regarded both "Hard Times" and "Summer's Here" among the better songs on Dad Loves His Work, helping Taylor bounce back from his previous "spotty" album Flag.

"[10] Record World described the song as "pretty pop A/C fare" and said that "James works his attractive tenor effectively on cute chorus trades with David Lasley and Arnold McCuller.

"[12] Michigan Daily critic Ari Roth stated that "Hard Times" "assert[s] a dependency and will to achievement that Taylor has never previously articulated.

"[13] Michael Hochandel of Schenectady Gazette reported that "Hard Times" received as much applause in 1981 live performances as Taylor's classics.

[5] Montreal Gazette critic John Griffin similarly described the song as "simply a goofy ode to 'my favorite time of year.