After the close of session for the National Assembly he remained in Paris, where he founded a large grocery business (épicerie), for which the journalists of the Left dubbed him "l'Épicier".
Accused of hoarding and suspected to plotting with the royalist émigrés, he emigrated himself, at first to Great Britain and then to Switzerland, where he placed himself in the service of the comte de Provence.
Under the French Directory he returned to France in February 1797 to take in hand the electoral campaign of the royalist party, with some success, though he was not elected to the Council of Five Hundred.
After the Coup of 18 fructidor (4 September 1797) he escaped arrest by fleeing once more to Switzerland, and remained abroad for a decade, faithful to the comte de Provence, now proclaimed "Louis XVIII" by the royalists.
With the Bourbon Restoration he followed Louis XVIII to France, and was pardoned for his defection, 1809–1814, and appointed general director of police, and superindendant of the Maison du Roi.