Escaping while being transferred to Aix, he took refuge there for the last time from 16 July to 7 September 1778 before being returned to Vincennes.
It was in 1772 that he made his longest stay there, during which he built in the castle a theatre capable of holding 120 spectators.
Crippled with debts, in year IV of the Republic (1796) the castle and its estate were sold to Rovère, deputy of Vaucluse and a native of Bonnieux, who, a victim of the Coup of 18 Fructidor, was deported to French Guiana where he died at Sinnamary in 1798.
Each year, prior to his death, he organised a musical artistic festival in the quarries to the west of the castle.
In the album Le Vampier the castle is the centre of a proto-Nazi plan to purify the Aryan race.