It is still owned by the descendants of Robert Harley, Earl of Oxford, chief minister under Queen Anne and is a Grade II* listed building.

[1] The house was built around 1660 by Edward Harley to replace Brampton Bryan Castle, which had been destroyed during the Civil War.

It was constructed in three storeys of brick and sandstone, with a Welsh slate roof and enhanced and enlarged in the 18th century.

It contained a deer park and is today Grade II listed in its own right.

[2] The family lived in the Brampton Bryan Castle until its slighting in 1644 by Parliamentarian forces during the ownership of Robert Harley, for which he later received significant financial compensation.