Studied violin from the age of four with his father, Tibor Varga, a famous Hungarian violinist and conductor.
After an accident brought an abrupt halt to a promising solo career Gilbert studied conducting under Franco Ferrara, Sergiu Celibidache and Charles Bruck.
In 1990, his final year as Music Director, he conducted their debut tour to Hungary with Yehudi Menuhin.
In 2001–2002 his engagements included Orchestre National de Belgique, RAI National Symphony Orchestra, Gothenburg Symphony (with whom he made a successful recording with trombonist Christian Lindberg) and performances at the Schleswig-Holstein Musik Festival.
Furthermore, he is chairman of the jury of the International Violin Competition Henri Marteau in Lichtenberg and Hof, Germany.