Most of the castle was destroyed during the English Civil War, leaving only a single gate tower, part of a wall, and a gateway.

[7] The manor passed through several hands before coming into the possession of Richard Neville, 16th Earl of Warwick in the 15th century.

[9] In October 1551, Mary of Guise the widow of James V of Scotland stayed a night in the castle as the guest of Sir Richard Cotton.

[9] In January 1643 Parliamentarians under Colonel Richard Norton of Southwick Park garrisoned the house with a force of between 40 and 80 men.

[3] As of May 2020, the owners of the castle were retired Olympic rowers Tom and Diana Bishop who live in the seven bedroom Old Farm House on the property.

[19] The tower was notably featured in a scene from Ken Russell's 1975 film of The Who's rock opera Tommy, when Roger Daltry leapt off the top strapped to a hang glider to the song Sensation.