[1] The lyrics use a complete verse from Willie Dixon's 1954 song "I Just Want to Make Love to You", originally recorded by Muddy Waters.

For this reason, the song is occasionally referred to as "Gone Daddy Gone/I Just Want to Make Love to You", as on Permanent Record: The Very Best of Violent Femmes.

Eric Weisbard in Spin Alternative Record Guide said the "febrile vibes and springy guitar on 'Gone Daddy Gone' — make the record an early document in the coalescing of a new wave of generational angst in the 1980s".

[3] Dan Hintz of the Krishmatics said, "The song is a real gem due to the sociopath vocal delivery, the skittering and shuffling drums, the brilliant melody line on the xylophone, the buzzing guitar and bass interplay, the love-is-false lyrics.

[6] A cover version of the song was the third single released in the United States by the American soul duo Gnarls Barkley, and is taken from their first album St.