[3] The house was rebuilt in 1403 by James de Radcliffe, who was lord of the manor of Radcliffe, and consisted of a stone-built hall and one or two towers, probably built with ashlar blocks.

[2][3] De Radcliffe was given a royal licence to fortify the site including adding crenellations and battlements.

[4] The manor house was demolished in the 19th century leaving only the tower.

[3] Radcliffe Tower is about 3.3 km (2.1 mi) south of Bury Castle, a late 15th-century moated manor house.

In 2009, plans to restore the shell of the tower as part of a wider restoration project covering Radcliffe E'es, Close Park and the parish church were launched with the support of Bury Council.