"[4] AllMusic critic Bret Adams later called the song "a terrific hit single," citing its "catchy chorus" and "nifty synthesizer lick.

"[5] Billboard described it as a "gothic ballad" and compared it to Foreigner's previous single "I Want to Know What Love Is" by stating that "That Was Yesterday" has "thrumming synths...rather than soaring choristers.

"[7] Cash Box described it as a "mid-tempo rocker" and said "brooding and at times powerful, 'That Was Yesterday' takes a hard look at a lost romance and Lou Gramm's lead vocal is emotionally biting.

"[3] Chicago Tribune writer Jan DeKnock made it a "Pick Hit" saying it likely won't perform as well as "I Want to Know What Love Is" because "its harder rock edge will keep it off some of the adult contemporary stations that made 'Love' such a big hit" but said that "That Was Yesterday" is "just the kind of good, solid mainstream rock that always finds a place on the charts.

"[11] Knight News Wire writer Rick Shefchik criticized the song as being "sludgy," whose primary audience is "late '20s to early '30s stockbrokers on cocaine.

[13] But The Daily News Journal music writer Curt Anderson criticized the fact that the slow keyboard buildup went nowhere, "as if the mere sound of a synthesizer is all the song needs.