[1] It is thought that a castle may have been built here by the MacDuff Mormaers, or Earls, of Fife in the 11th century, at the time of King Macbeth of Scotland (d. 1057).
The Wemyss family, descendants of the MacDuffs, owned the property from the 14th century, and built the earliest part of the present castle.
However, Wemyss later joined forces with Robert the Bruce, and Edward ordered the castle to be destroyed.
[1][2] However the eastern tower was demolished by Fife County Council in 1967 after a child was injured falling from it.
[3] A 16th-century dovecote formerly stood at the edge of the shore to the south of the castle, but was destroyed by sea erosion in the 1970s.