Oxford Collapse first released a limited press self-titled EP for the HCR label in 2002.

Shortly after they signed to Kanine Records, a label based in New York City/Brooklyn, where they released their first full-length album Some Wilderness in April 2004.

The band then signed to indie label Sub Pop, where they released Remember The Night Parties in October 2006.

The album earned a 7.9 out of 10 from Pitchfork Media, who also rated "Please Visit Your National Parks" 96th in their year-end "Top 100 Tracks of 2006" feature.

[1] Mike Pace has subsequently gone on to form the band The Child Actors, who released their first single in March 2012.