They are known for their explicit lyrical content, which is devoted to matters of sexual purity and sin, including abstinence, masturbation, pornography, sex ed, and related topics.

The band's creators see themselves as performing a legitimate ministry with a message which is often marginalized or poorly approached in churches and completely taboo in contemporary Christian music.

The band was originally formed by Doug Van Pelt (editor of HM), Maury Millican (a youth pastor), Philip Owens, and Paul Q-Pek (both of One Bad Pig).

A limited edition release, The Worst Of... (2000), contains the original selections of the band's complete catalog (including Feminazi), plus a cover of Steve Taylor's "I Blew Up The Clinic Real Good.

"[5] An enhanced version of We Are Not Ashamed was released in 2006, which included extras such as an audio commentary by Doug Van Pelt and another complete remaster of This Is A Condom Nation.