A narrow courtyard led to the centre of the peninsula with buildings on both sides, such as the barracks, the brewery, the chapel, etc.
The castle was reached from the mainland via a drawbridge, which spanned a wide ditch cut into the rock, protected by a gatehouse and a defensive wall.
It was originally thought to have been constructed in the 12th century, by Harald Maddadson, Jarl of Caithness and Orkney.
[2] Reginald le Chen of Inverugie and Duffus, is known to have been in possession of the castle in the early 14th century.
The castle later passed by the marriage of Christian, the daughter and heiress of Alexander Sutherland of Duffus, to William Oliphant in the 15th century.