It was built between 1635 and 1640 by François Mansart, for Louis Phélypeaux, seigneur de La Vrillière.

[2] After the death of Toulouse in 1737, the Hôtel became the Parisian residence of his son, Louis Jean Marie de Bourbon, Duke of Penthièvre, and the birthplace of the latter's daughter, Louise Marie Adélaïde de Bourbon.

The princesse de Lamballe, who was the Duke of Penthièvre's widowed daughter-in-law, also resided there until the French Revolution.

[3] The Hôtel de Toulouse was the site of a scene from Sofia Coppola's Marie Antoinette with its famous Galerie dorée[4] (one of Robert de Cotte's masterpieces) as a room in a palace of her youth.

Other films, both French, shot at the site are Vatel and Tous les matins du monde.