A product of the Caen youth system, he has played mainly in France for AS Cherbourg, Bordeaux and Strasbourg, as well as a spell with English side Aston Villa.
[2] On 31 January 2019, Guilbert signed for Aston Villa for an undisclosed fee, but would remain at Caen on loan until the end of the season.
Guilbert's Villa career started positively, described by Paul Doyle in The Guardian as "solid defensively and a regular threat going forward.
[14] On 17 January 2023, after not having made a senior competitive appearance for Aston Villa since August 2021, Guilbert signed for Strasbourg on a permanent transfer for an undisclosed fee.
[16] On 27 August 2024, Lecce announced that they had signed Guilbert to a two-year contract on a free transfer from Strasbourg, with an option for a third year.