The group's name is a reference to both an illustration and the term for the 50-foot sound wave of the lowest F tone audible to the human ear.

The band was designed as a power trio, with a lineup including drummer Rob Ahlers and Throwing Muses bassist Bernard Georges.

The band's first live performance was recorded in Burbank in October 2003 and released on a very limited basis as an official bootleg.

Among other live appearances internationally in 2004, 50 Foot Wave performed a month-long residency of shows in January that year at the Silverlake Lounge, while the group was based in the Los Angeles area.

The group toured Europe and the United States in 2005, while Hersh simultaneously continued her solo concerts in alternating parts of the year.