This was the only track credited solely to bass player Phil Small on any of the band's albums apart from "Notion For You" on the 1994 rarities album Teenage Love (Small co-wrote "The Game" from Twentieth Century with Walker).
The song proved to be one of the band's most popular, featuring a clearly defined pop sound quite different from Cold Chisel's more usual hard-edged rock.
Promotional copies sent to radio stations there were wrapped in a baby's nappy as a marketing gimmick.
However, the 1980 b-side version remains unique in that it includes Steve Prestwich's count-in, trimmed from subsequent reissues.
On the 2007 tribute album Standing on the Outside: The Songs of Cold Chisel, "My Baby" was covered by Thirsty Merc.