Since 1883, it has been an extension of the École nationale supérieure des Beaux-Arts, a distinguished National School of Fine Arts.

This hôtel was constructed in 1635 by the entrepreneurs Simon Delespine (d.1680), Martial Baret and Jean Péronne for Macé I Bertrand de La Bazinière, a royal treasurer.

Her older son, Emmanuel Théodose lived here and several of his children were born here, such as the future Duke of Bouillon Charles Godefroy de La Tour d'Auvergne, Anne Marie Louise, the Princess of Soubise and his youngest child, the future Princess of Craon.

The Duke's son and successor Charles Godefroy de La Tour d'Auvergne had the building remodelled between 1741 and 1744 by the architect François Debias-Aubry.

During the First Empire, Napoleon I gave the hôtel to Stéphanie Tascher de La Pagerie (1788–1832), the cousin of Empress Joséphine.