This album solidified the band's sound and was a critical and commercial success, peaking at number 35 on the US Billboard 200 chart.

Following the release of their debut album, Everything All the Time, founding members Mat Brooke, Chris Early and Tim Meinig all left the band.

Ben Bridwell described the sound of Cease to Begin, "I guess the first record had some kind of country-ish leanings...I think there's maybe a little bit more of [that] feeling on it, a little more down-home...not so much indie rock.

[18] The album's second single "No One's Gonna Love You" was featured as a free iTunes download, distributed at Starbucks locations.

While not being released as a single, "Cigarettes, Wedding Bands" was featured in the tracklist of 2009 video game Guitar Hero 5.