The band came to prominence when it posted an early version of the song "Je veux te voir" on MySpace in September 2005, which later reached the top five in France.

The success of the song on MySpace attracted the attention of a record label, which set them to work on their debut album, Pop Up, which was released in 2007.

Budet met and became good friends with producer GrandMarnier in 2000, and in 2005, they began making music together when both wanted to start an electropop band.

[4][6] Yelle rose to fame on MySpace when they posted a song titled "Short Dick Cuizi", which later became "Je veux te voir", in late 2005.

[7][8][9] The song's original title refers to Cuizinier of French alternative hip-hop band TTC and was released as a mock diss track.

[12] The band has enjoyed success outside France despite making songs exclusively in French and have toured extensively overseas in non-French-speaking countries.

The album was co-produced by Dr. Luke and his team of producers (Kojak, AC, Billboard Mat, Oliver, Cirkut, Jmike, Madmax), who discovered Yelle through their remix of Katy Perry's "Hot n Cold" and a live show in Los Angeles.

[23] Complètement fou was released on 29 September 2014 through Kemosabe and followed by an extensive international tour that saw the band play at Coachella for the third time in their career as well as all over Europe, the Americas, and China.

The debut single "Je veux te voir" was a humorous reply to the misogynist lyrics of some French rappers, especially Cuizinier of TTC.

[18] Budet described it as a marriage between "hotter rhythms and cooler synthesizer", highlighting the sense of humor and melancholy coexisting in the lyrics as well.

[22] Budet's colorful stage outfits are influenced by designers such as Jeremy Scott, Andrea Crews, Jean-Paul Lespagnard and Jean-Charles de Castelbajac.