He was permitted to build a tower as high as he liked, with iron yetts, machicolations, portcullis, drawbridges, and other "strengths".

[4] In 1564 Patrick Cheyne was created baron of Esslemont by Queen Mary, who stayed here during her campaign against the Earl of Huntly, and a fortalice and tower were recorded in 1575–6.

In 1728 it became the property of Robert Gordon and may have been partially occupied till 1769, when the existing mansion, Esslemont House, was erected in its vicinity.

Finds from the excavation included 14/15th century potsherds, a medallion, and a worn shilling of William III.

[7] The castle is roofless and missing large sections of wall which were reused in building sites nearby.