This building was originally one of eight pavilions intended to structure the Place Royale/Koningsplein, known as the Hôtel de Templeuve, and was to serve as the private mansion of Countess Brigitte of Tirimont-Templeuve (born Scockaert de Tirimont, family of which she was the last survivor), who agreed to her old town house demolished and rebuilt in accordance with the project of the new square.

From 1834 to 1839, it housed the Ministry of War, then the politician Charles-Ghislain Vilain XIIII lived there, and finally the Royal Athenaeum of Brussels occupied the building from 1861 to 1865.

After the death of the Count in 1905, his children sold the residence to the Banque de Bruxelles, which proceeded to adapt the perpendicular wings.

Other developments were undertaken after the Second World War, notably between 1957 and 1959 with the extension of the Rue de la Régence wing.

Sold in 1982 to the Belgian State, since January 1984, it has housed the headquarters of the Court of Audit of Belgium, previously located on the Place Royale.