It was described by W. Douglas Simpson as one of the nine castles of the Knuckle, referring to the rocky headland of north-east Aberdeenshire.
[2] The 17th-century Philorth Castle, an L-plan house consisting of a sizeable crow-stepped block, was demolished after a fire in 1915.
[4] In 1896, the two towers were restored and its central building rebuilt by Jenkins & Marr for Sir John Duthie, a barrister.
[4] In the late Victorian period the castle, by now almost a ruin after a 1915 fire,[3] was purchased and restored by the wealthy Duthie family of Aberdeen.
[2] Flora Fraser, 21st Lady Saltoun, and her husband, Captain Alexander Ramsay of Mar, who was one of Queen Victoria's great-grandchildren, lived there for a while.[when?]