They first reached local prominence in 2005, after completing their first United States tour with Kimya Dawson of the Moldy Peaches.

2006 also saw the departure of Joey Seward and his subsequent replacement by keyboardist Stefan Rubicz and bass player Ryan Thompson.

In September bassist Ryan Thompson was kicked out of the band amid the recording sessions for Choose Yr Own Adventure.

In 2011 the band released their well received 7-inch EP, "Dig Your Grave" via Kind Turkey Records, Bobby Hussy's (The Hussy, Fire Heads, Cave Curse, TIT) record label based in Madison, WI.

Scott Yoder also performs/records in a side-project called Fuzzy Cloaks with fellow Pharmacy member Stefan Rubicz.

Bobby Hussy's label Kind Turkey Records released the debut cassette shortly after the band formed.