Born in Vieux-Condé, Pollet began his career as a trainee at Cannes, breaking into the first team in 1991.
He was signed by Ligue 2 side Le Havre in Summer 1995 and he became a first choice player as the club won promotion.
He remained a first choice player during the 2000–01 campaign, but the following summer saw new manager Dave Jones reshape the squad, relegating Pollet to the substitutes bench.
He was eventually released by Wolves in June 2003, days after they gained promotion to the Premier League.
Pollet then returned to his native France with Dunkerque, where he played for three further seasons, before retiring and becoming an assistant coach at the club.