Following "Leaving the Nest," an EP of six songs released jointly by Box Theory and Planaria Records in October 2005,[1] Ferree signed with Domino Records US/UK.

They added four new songs to the original EP and released Ferree's full-length debut album - also entitled Leaving the Nest - in late 2006.

Live, Ferree plays a Fender Telecaster and KORG SV-1, as well as a Little Phatty, moogerfoogers, Polyevolver, and a moog theremin plus.

Sometime touring band member Drew Mills of the Philadelphia band Blood Feathers (formerly of Aspera) has played custom made Wurlitzer drums and guitar.

Ferree's live band has also included Laura Harris of The Aquarium (Dischord Records) and Ex-Hex (Merge), Amy Domingues of Garland of Hours, Jonah Takagi of Atelier Takagi, and Little Jack Lawrence On Oscar Sunday, 2012, Ferree released the G.U.S.