He also purchased Pølsegården, a farm that Tersling had failed to acquire, where he most likely resided until the buildings on the Klintholm estate had been completed.

[3] Jacob Scavenius purchased numerous properties in the surroundings, extending the estate to an area of some 3,000 ha (7,400 acres).

In 1819, all the Klintholm buildings were destroyed by fire but were quickly reconstructed by Scavenius' widow Kathrine in 1820.The new complex included a brick factory and a limestone plant.

Carl Scavenius and his wife Thyra Castonier made the estate their principal home in 1869 as the first owners since Staal's death in 1797.

Carl Sophus Scavenius who found the main building too small for his wife and 10 children, built a grandiose new manor in 1873–75.

In 1878, he started the construction of Klintholm Havn which served to transport the estate's products.

He also encouraged tourism by setting up the Møns Klint Camping and the Ålekroen, a restaurant in Klinthom Havn.

With its tower, its projecting lateral wings, its mansard roof, Dutch gables, large windows and sculpted limestone decorations, the grandiose building fully reflected the Historicist trends of the times.