The band played their first show together in Newburgh, New York at the Hudson Valley skate park in 1991.
The lineup was Darryl Quirk, Sam Carbone, Tom Connelly (three members from A.W.O.L., an earlier hardcore band from Newburgh, N.Y.) and Mike Score.
[3] The band's lineup shifted frequently in its early years before their first full-length release Truth in the Age of Lies on the German record label Gain Ground in 1997.
In late June 2015, All Out War released a new EP, Dying Gods, on Organized Crime Records.
In early February 2023, they released a more black metal-influenced album, Celestial Rot on Translation Loss.