"I Can't Stay Mad at You" followed on the popular success of Davis' earlier 1963 crossover hit "The End of the World".

[1] According to Allmusic critic Richie Unterberger, "I Can't Stay Mad at You" was recorded in the popular "girl group" musical style.

Unterberger also explains that the song displays similarities to Neil Sedaka's pop hit "Breaking Up Is Hard to Do", stating "'I Can't Stay Mad at You' begins with a whole verse worth of ultra-catchy doo wop syllables ('Shooby Dooby Doo Bob') that, frankly, is highly reminiscent of the similar patterns used in Neil Sedaka's No.

In fact, the whole song is fairly reminiscent of that previous Sedaka hit, though 'I Can't Stay Mad at You' is, to its credit, a little brighter and more exuberant.

In August 1963, "I Can't Stay Mad at You" was officially released as a single by RCA Victor, with the b-side being "It Was Only a Heart".