Then Marshal of the Sejm Tadeusz Franciszek Ogiński (1712–1783) (married to Izabella née Radziwiłł) took over the lease.

Michał Ogiński didn't spend time at Rietavas, however, preferring life abroad (including Paris, Constantinople, Vilnius and Florence).

Diarist and writer Stanislaw Morawski, in his autobiography “My Years of Youth in Vilnius” wrote: Apart from Zaluska [Amelia, born on 10 December 1803, who later became Countess Zaluska] conceived with Ogiński, every one of his daughters [Emma and Ida, born in 1805 and 1813 respectively] had a different father.

Ireneusz was a very good-looking boy, which he used to his advantage around the Ogiński estates and in the courtly circles of St Petersburg.

After Michał died, Prince Ireneusz Ogiński inherited Rietavas, settled there and built a new residence in the second half of the 19th century.

When Jozefina died in 1844, Ireneusz became a still young, very eligible and fabulously wealthy widower, which was noted in the St Petersburg court four years later when it was discovered that Olga (Bogdan's wife's sister) was pregnant.

The important fact was that the Ogiński name, a very good one and totally acceptable for an imperial child, had become available at a time when it was most needed.

He was also a member of the Animal Care Society, who worked hard to save the Lithuanian breed of Žemaitukai horse from extinction.

The devastation of the manor continued during World War I, when many valuable items, musical instruments and works of art were removed from the palace to Germany.

In 1926 it was sold at auction to Povilas Jurgaitis who demolished the palace and built brick houses.