[1][2] The property, believed to have been built in the late 15th century as a pele tower, was first recorded in a survey of 1541.

[3] During the early years of the 19th century Harle Tower was inhabited by Lord Charles Murray-Aynsley and his wife Alicia, née Mitford.

The central two-storey block of five bays dates from the early 18th century.

[6] Substantial additions were made in the Gothic Revival style in about 1862, but much of the 19th-century work has not survived a remodelling of the property in 1980.

[7] The 19th-century stable block is also a separately listed Grade II building.