[1] The house and the stables are Category B listed buildings[2][3] and the grounds are included in the Inventory of Gardens and Designed Landscapes in Scotland.

Walter Ogilvy then built the castle at the confluence of the River Isla and the Melgam Water.

Parliamentarian troops under the command of Archibald Campbell, 8th Earl of Argyll destroyed the castle in 1640; the ballad "The Bonnie Hoose o' Airlie" describes the incident.

James Ogilvy (d. 1731), the grandson of the first Earl, took part in the Jacobite rising of 1715 and was attainted; consequently, on his father's death in 1717, he was not allowed to succeed to the earldom, although he was pardoned in 1725.

In 1778 David Ogilvy too received a pardon and he returned to Scotland from exile in Versailles.