From 2002 to 2004, the group recorded demos at home and in their dorm rooms while playing local shows in Springfield and Columbia, Missouri.

[1] In Fall 2004 the group began recording their first full-length album, Broom, at Knauer's house, which is featured in much of the band's artwork.

The debut was seen as an indie success, and received favorable press in Spin Magazine and internet buzz from blogs like You Ain't No Picasso and Bars and Guitars, while Pitchfork gave the album an average rating, 6.9/10.0.

In February 2006, the band went on their first national support tour opening up for Catfish Haven (from the Secretly Canadian label).

In July 2007, SSLYBY performed at the Afisha Picnic music festival in Moscow, Russia, just three months after the death of Boris Yeltsin.

[9] Pershing was named the best album of 2008 by the blogs It's Hard to Find A Friend,[10] The Stark Online,[11] and The Power Pop Show.

[15] SSLYBY's third album under Polyvinyl, Let It Sway, was produced by Chris Walla of Death Cab for Cutie and Beau Sorenson.