The band formed in 1994, around the time the Dead Milkmen announced their plans to disband the following year after a final tour and album.
They crafted a distinct sound drawing from several forms of folk music (including Irish and Americana styles) and a "Pogues-esque"[1][2] punk rock sensibility, with a dark element sufficient to frequently earn them "goth" and "gypsy" tags.
[3] This dark edge, reflected in songs of murder, misery, alcoholism, pestilence and the occult, was a sharp left turn from the Dead Milkmen's comedic lyrical motifs, although Burn Witch Burn lyrics were not without their own sense of black humor (notable in such songs as "Treetop Flotilla", which includes an anecdote about an abusive, Led Zeppelin-listening "fake biker".)
The band also utilized an array of unique instrumentation, including the tin whistle, violin, mandolin, banjolin, bouzouki, melodeon, and hurdy-gurdy, in addition to the standard guitar, bass and drums.
The album included re-recordings of much of the band's first two minor releases, some new original material, and a Rolling Stones cover, "Citadel".