She felt a man would be unable to create a similar song, feeling he would lack “the same personal investment that motivated the lyrics to be written".

Ethnomusicologist Chris Wilson described "Remember That" as a "rare exception among cowritten Nashville songs" as its message took precedence over its chances of becoming a "money-making hit".

[8] Jon Caramanica, writing for The New York Times, interpreted the singer's delivery of the line ("remember how he told you you were stupid") as aimed at critics of her personality on the reality show Newlyweds: Nick and Jessica.

[2][10] Proctor and Banks wrote cards to North American country radio to promote the song, though the stations refused to play it.

Simpson performed "Remember That" as part of her debut at the Grand Ole Opry, introducing it as "a very personal song for a lot of women".

Simpson was praised by Rolling Stone's Caryn Ganz Simp as having "tender voice [that] exudes the realism of a gal who’s taken a few knocks in her day",[12] and Caramanica for "f[inding] a backbone" through the single's message and lyrics.

[9] Sputnikmusic's Willie noted that Simpson's "passionate vocals" separated "Remember That" from similar songs on abuse.

[8][9] Caramanica wrote "Remember That" was where Do You Know "finds its groove",[9] and Jennifer Webb of About.com praised how it was paired with "Pray Out Loud" to ease listeners from its focus on abuse.

[8] Alternatively, Slant Magazine's Jonathan Keefe dismissed it as "a knockoff of Martina McBride’s shrill domestic violence empowerment anthems".