[4] Drawing influence from such bands as Gauge and Fugazi,[5][4] Cap'n Jazz recorded several singles for independent labels in the early 90s as well as contributing to several compilations.

In 1995, the band released its only full-length album, Burritos, Inspiration Point, Fork Balloon Sports, Cards in the Spokes, Automatic Biographies, Kites, Kung Fu, Trophies, Banana Peels We've Slipped On and Egg Shells We've Tippy Toed Over, on the Man with Gun label.

In 1998, Jade Tree assembled a double-disc Cap'n Jazz retrospective titled Analphabetapolothology which compiles the band's complete recorded works (save for Naive, their song on Achtung Chicago!

Cap'n Jazz reunited at the Empty Bottle on Friday, January 22, 2010, as part of Joan of Arc's Don't Mind Control Variety Show.

[15] Former members of the band continue to play music, most notably in Make Believe, The Promise Ring, American Football, Owls, Ghosts and Vodka, Joan of Arc and Owen.