Composed of former members of Pretty Girls Make Graves (PGMG) after its disbandment in 2007, former PGMG member Derek Fudesco teamed up with Pete Quirk (of Hint Hint) and Marty Lund (of Cobra High) and began playing in the Seattle area.

[2] Soon after the band's conception, The Cave Singers signed with Matador Records on June 11, 2007.

The band released the limited edition single 7" "Seeds Of Night" including b side "After The First Baptism" on August 2, 2007.

On August 18, 2009, The Cave Singers released their second album, Welcome Joy, featuring guest appearances from Amber and Ashley Webber of the band Lightning Dust.

[4] Matador Records gave away a free download of the track "Beach House" to fans.