Ups & Downs: Early Recordings and B-Sides is a B-Side compilation album by Saves the Day, released on Vagrant Records on August 24, 2004.

As the title suggests, it is a compilation of early recordings and B-sides, recorded between 1997 when they were known as Sefler to the live reworking of "Jessie & My Whetstone" in 2003.

The compilation also includes the entire I'm Sorry I'm Leaving, remastered and without the Modern English cover, "I Melt with You", as well as for the first time on CD, the EP's vinyl-only track "The Way His Collar Falls".

All lyrics written by Christopher Conley, all songs written by Saves the Day.