Laetizia Bonaparte, Napoleon's mother (Madame Mère), lived here during the First French Empire, and Charles de Gaulle used it as his office at various times during the Second World War.

Duret was a friend of the Marquise de Prie, mistress of Louis Henri, Duke of Bourbon (Prime minister of France and another Prince of the Blood).

Madame de La Vrillière lived at Brienne till 1733 when it was sold to the sister of the disgraced Duke of Bourbon.

The new hôtel was near the Palais Bourbon, built by Louise Élisabeth's mother known as Madame la Duchesse Douairière.

The hotel would be named after the Conti family till 1776, following death of the Dowager Princess in the previous year, when it was sold to the Comte de Briene.

In 1800, the hôtel awarded by a court to Joseph Lanfrey, who rent it to Lucien Bonaparte, then Minister of the Interior, and Napoléon's brother.