She first met Spencer Fox, a former child actor who voiced Dash Parr in the 2004 film The Incredibles, outside of a Tokyo Police Club show at New York's Webster Hall.

Fox moved to Westport midway through his junior year of high school and began collaborating with Eva on songs.

Eva planned to go to New York University (NYU)'s Clive Davis Institute of Recorded Music post-graduation, and wanted to have a finished product to enter the program with.

[10] In June 2014, they released the EP Soft Serve, which included a three-part video series as well as a comic book trilogy.

At that time, Shure was directing off-Broadway productions but was an early fan of the band and did not want to miss the opportunity to join.

Charly Bliss began recording their debut album, Guppy, in 2015, but shelved the first result, feeling as though it did not sound like them.

[9] To commemorate the release, the band launched a 24 hour livestream on their youtube channel called CBTV, which included a full stream of the album, behind the scenes footage, and Charly Bliss-themed spoofs of TV shows, such as MTV Cribs.

[18] In 2020, the group contributed a cover of the song "Pretend to Be Nice" from the Josie and the Pussycats soundtrack for Saving for a Custom Van, a tribute compilation celebrating the life of musician Adam Schlesinger.

The band have also been inspired by the Killers (frequently covering "Mr. Brightside" on their Young Enough tour), Cibo Matto, the All-American Rejects, Fountains of Wayne[9] and Kate Bush.