After the Chancellor's death the property was inherited by his daughter Helena Tekla Ossolińska, wife of Aleksander Michał Lubomirski, Starost of Sandomierz (from whom it takes its name).

Later, between 1681 and 1696, it was rebuilt and remodeled by Tylman Gamerski and Giovanni Bellotti for Prince Józef Karol Lubomirski – Aleksander Michał's son.

On 27 May 1787, the palace played a key role in a plot by Russian ambassador to Poland, Otto Magnus von Stackelberg.

However, as a large Polish army could be a threat to the Russian garrisons controlling Poland, von Stackelberg ordered his proxies in the Permanent Council to spend the money on a different goal: for the huge sum of 1 million zlotys (representing most of the surplus), the council bought the Brühl Palace – and promptly donated it to 'Poland's ally', Russia, to serve as Russia's new embassy.

[4] On 11 November 2018, during celebrations of the 100th anniversary of Poland's restored independence, President Andrzej Duda signed a declaration on the rebuilding of the Brühl Palace.