In Danish times, the castle was called Krogholm and its most famous owner was Baron Jörgen Krabbe who was a native Scanian Dane who chose to pledge faith to the Swedish Crown when Scania was ceded to Sweden in 1658.

During the Scanian war of 1676–1679, Krabbe was imprisoned and executed on the charge of collusion with the Danes and high treason.

Several of his employees, including the estate manager Christopher, also got executed by the Swedes.

Krabbe's widow, Jytte Thott, had to sell most of the family properties, including Krogholm, because they had been impoverished during the war.

In 1704, the castle was sold to Carl Piper (1647–1716) and its name was changed to the more Swedish-sounding 'Krageholm' which it has kept all since.