Todd Anthony left shortly after the band's first few shows and was later replaced by Joe Naylor.
Naylor took over bass playing duties after Keith Allen left the band in 1999.
The first, Nowhere to Run, was produced by Dave Smalley of Dag Nasty and Roger Miret of Agnostic Front, and was released on Mendit Records in 1999.
In 2002, Under The Gun reunited, this time with Joe back on bass, a new lead guitar player, SEJ, and Chris and Mickey resuming their previous duties.
Chuck Francis took over on bass, and after a few shows, Under The Gun gave way to No Class Heroes in 2003.