The band was formed in 1986 by singer Dallas Denery and singer/guitarist Matt Buenrostro with Crispy Jim (later of The Saddlebacks) on bass and Dr. Frank (the frontman of The Mr. T Experience) on drums.
Frank and Crispy Jim did not appear on any Sweet Baby recordings, having been already replaced by Sergie Loobkoff (Samiam, Knapsack) and Richie Bucher (Jüke, Wynona Ryders), respectively.
Their song "Andorra" was on the Lookout Records compilation double LP The Thing That Ate Floyd released in 1992.
Lookout Records re-released the band's It's A Girl album on compact disc in 1995, and Eccentric Pop Records released a remastered vinyl LP version with a bonus 7" containing unreleased studio and live tracks in 2015.
The East Bay, California based punk rock band now known as Green Day was originally called Sweet Children, but changed their name before releasing their first EP 1,000 Hours to avoid confusion with Sweet Baby.