In 2004, rapper Radovan "Radek" Banga released the solo album Ya favourite Cd Rom and later met violinist Vojta Lavička and brothers Jan (upright bass) and Petr Surmaj (guitar and accordion), with whom he formed the group Gipsy.cz.

They rose to fame in 2006 with the single "Romano Hip Hop", from the album of the same name, which reached the MTV World Chart Express[1] and was later certified Gold in the Czech Republic.

The song "A na závěr si s námi dejte trochu té Čunárny" stimulated discussion, as the title and lyrics mocked politician Jiří Čunek, who is known for his anti-Roma comments.

[1] The band took part in the Czech preliminary round for the Eurovision Song Contest in 2008, but again failed to qualify.

Jan and Petr Surmaj left Gipsy.cz in January 2009, and after filling out the vacant musical seats, the band finally succeeded in their repeated attempts to represent the Czech Republic at the Eurovision Song Contest in Moscow, Russia, with their song "Aven Romale".