During the late 14th century, it became part of the royal Danish crown land, and was owned by king Valdermar Atterdag and later by his daughter, queen Margrethe.

In 1630, Palle Ulfsted sold the property to Danish nobleman Otte Marsvin, who constructed the present castle 1644–1648, naming it after his family.

The castle was renovated thoroughly between 1782 and 1786 by count Erik Ruuth, and in 1856-1857 baron Jules Sjöblad hired Danish architect Ch.

Due to the Scanian War (1675-1679), the pro-Danish owner Holger Thott was stripped of the castle by the Swedish crown.

It has since then - through inheritance and sale - belonged to the Swedish families von Königsmarck, de la Gardie, Sjöblad, Ruuth, Piper, Tornerhielm and Wachtmeister.