During his freshman year of college, Ferguson teamed up with Ben Fulton and Bryan Gore to form Big Fresh in 1998.
In 2002, Ferguson met Robert Schneider of The Apples in Stereo, and they formed Ulysses.
Their first release, 010, appeared in 2004 on the Eenie Meenie Records label, and received positive reviews.
In 2006, Schneider invited him to become a member of the Apples In Stereo, and Ferguson performed on the band's 2007 album, New Magnetic Wonder.
Ferguson is also a member of the synth-folk band Deek hoi, continues to collaborate with R. Stevie Moore and perform with Big Fresh.