She has released three solo albums, an EP entitled How I Got Away (1999), and also has exclusive tracks featured on both Asthmatic Kitty Records Samplers.
Stephens was also featured on a bonus track of Denison Witmer's 2002 release titled Philadelphia Songs on "Burnt Toast Vinyl" (US).
Stephens was the lead singer in the Holland, Michigan band Marzuki that featured Sufjan Stevens on the guitar, drums, and recorder.
Several of her old band members including Paul Mumaw (Rockstar Crush), Jason Harrod, Kenny Hutson (Vigilantes of Love) and Sufjan Stevens appeared on her self-titled release.
The song "I'll Be Glad" from her first album was covered by Bonnie 'Prince' Billy on his 2008 release, Lie Down in the Light.