[1] During the Middle Ages the residence was called Skurdorp (Skudrup), which was fortified and situated next to the parish church, where remains still can be seen.

During the midst of the fifteenth century it was owned by guardsman Henning Meyenstorp (Meinstrup) and through marriage it later came to the possession of the Sparre-family.

Approximately 1530 the residence was moved from Skurup to an islet in the Lake Svaneholmssjön, after that it was called Svaneholm.

Svaneholm Castle was initially erected in the 1530s[2] by the Danish knight and royal advisor Mourids Jepsen Sparre (1480–1534).

[4][5] At Maclean's death in 1816, Svaneholm Castle was inherited by his nephew Kjell Christoffer Bennet and his three siblings, 1839 it was sold to chamberlain Carl Johan Hallenborg, and belonged to his son and grandchild until 1902 when it was redeemed by count Carl Augustin Ehrensvärd (1854–1934), who was married to Eva Augusta Hallenborg (1864–1947).