She was a founding member, guitarist, and lead vocalist of the indie rock group the Like.

Following the hiatus of the Like in 2011, Berg formed the band JJAMZ along with James Valentine (Maroon 5), Jason Boesel (Bright Eyes/Rilo Kiley), Alex Greenwald (Phantom Planet), and Michael Runion.

[3] Following Valentine's departure from the band it was renamed Phases, and a new record, For Life, was released under the new name and lineup on September 18, 2015.

Music critic Dan Cairns described her voice as "Björk meets Harriet Wheeler".

In December 2018, Berg collaborated with Ryan Ross on the Christmas single "The Bad List".