Using biblical imagery, the song describes the birth of Elvis Presley during a heavy storm in Tupelo, Mississippi.

The "looky looky yonder" motif that is featured in the song is derived from a song of the same name recorded by Lead Belly, usually found as part of a medley which Cave himself covered under the title "Black Betty" on Nick Cave and the Bad Seeds' third album, Kicking Against the Pricks.

[citation needed] "Tupelo"'s B-side, "The Six Strings That Drew Blood", was recorded in March 1985 at Trident Studios in London and was a re-recording of a song Cave originally recorded with the Birthday Party during the Mutiny EP sessions in 1982.

The original version of the song is included on the Birthday Party's Mutiny/The Bad Seed compilation album.

The song was ranked number 5 among the "Tracks of the Year" for 1985 by NME.