He attended River Trails Middle School in Mount Prospect, Illinois, where he first met future Screeching Weasel co-founder John Pierson.

[3] When Foster returned to Illinois from the Élan School, he got a job at a local movie theater, and formed the band Screeching Weasel with co-worker and former junior high classmate John Pierson, aka Jughead.

(1988), My Brain Hurts (1991), Ramones (1992), Wiggle (1993), Anthem for a New Tomorrow (1993), How to Make Enemies and Irritate People (1994), Bark Like a Dog (1996), Television City Dream (1998), Emo (1999), Teen Punks In Heat (2000), and First World Manifesto (2011) On May 26, 2015, Screeching Weasel released a rock opera entitled Baby Fat: Act 1 on Recess Records, followed by Some Freaks of Atavism on March 24, 2020.

Records released a 7-inch EP by The Shotdowns which included Foster, Jughead, and rock critic Jim DeRogatis.

Weasel also wrote for other various zines, including Razorcake, Non-Stop Banter, Jersey Beat, Hit List and 10 Things Jesus Wants You To Know.

He wrote a novel in 2001 called Like Hell and put out a collection of his columns and articles in 2002 entitled Punk is a Four Letter Word.

In 1990 Foster wrote, produced, directed and starred in a low-budget "gay vampire" film entitled Disgusteen.

On Friday, March 18, 2011, at Austin, Texas's SXSW Festival, Foster was involved in an altercation with two women during a Screeching Weasel performance.

Foster originally stated he "can't kick a girl's ass" and offered money for another woman to handle the attacker.

As a husband, father, and a musician on the public stage, I understand that it is my duty to always take responsibility for my actions in a socially acceptable way, and most especially in the face of confrontation.

"Following the incident, several bands who were slated to appear at Weasel Fest in Chicago dropped out, including Chinese Telephones, Chixdiggit, The Soviettes, Teenage Bottlerocket and Kepi Ghoulie.

[12] On March 23, 2011, the other four members of Screeching Weasel all resigned from the band citing the SXSW incident as the reason.

[15] On November 30, 2010, Foster appeared on Last Call with Carson Daly and revealed that he suffers from anxiety, panic attacks, and bouts of agoraphobia.