In 1848, he became chief of staff of Minister of the Interior Léon Faucher and conseiller général of the Yonne department, in which Saint-Fargeau is located.
[2]: 205 In 1862 he was appointed vice-president of the Société du Prince Impérial [fr] by Empress Eugénie, whose personal finances he managed in that capacity.
[2]: 44 On 3 July 1857, Frémy became the chief executive (known as Governor) of the Crédit Foncier, succeeding Charles Le Bègue de Germiny.
[2]: 207 In 1862, the Crédit Foncier acquired the storied Hôtel d'Évreux [fr] on Place Vendôme, from which Frémy played a central role in the Parisian financial and business community.
[2]: 207 In January 1877, under the new regime of the French Third Republic, he was dismissed from his position at the Crédit Foncier at the instigation of Finance Minister Léon Say on the pretext of his investments in Egypt; Soubeyran was subsequently ousted in August 1878.
[2]: 209 By the end of his life he had ostensibly lost his fortune, and had to sell the mansions at Les Janets and L'Orme-du-Pont in 1884 and 1889 respectively,[2]: 210 even though in 1887 he still kept the villa on the Côte d'Azur.