Modified in the 1570s by the Forbes of Druminnor,[1] it was described by W. Douglas Simpson as one of the nine castles of the Knuckle, referring to the rocky headland of North-East Aberdeenshire.

[1] There is an arched gateway in the west wall of the outer court, with the date 1656 and the arms of the Forbeses and Erskines.

At the north-east angle of the courtyard, there is a tall flanking drum tower, with walls 9 feet (2.7 m) thick, built by the Frasers of Philorth.

[4] The castle was looted and destroyed by the Flemish troops of William Lascelles in 1845.

Around the same time, the castle was consolidated by Douglas Forrest architects, for Malcolm Forbes.