The precise date of construction is unknown but it is generally thought that the original tower was built around 1765 to 1770 by John Hanbury, a local landowner and ironmaster who owned Pontypool Park.

In May 1935, an estimated 15 to 20,000 people gathered at the Folly Tower to celebrate the Silver Jubilee of King George V with the lighting of a bonfire.

Pontypool Park Estate Office attached notices to the structure informing visitors of the potential dangers of falling masonry.

This was in the belief that its presence would be a landmark for the Luftwaffe seeking to raid the nearby Royal Ordnance Factory at ROF Glascoed to the east beyond Little Mill, Monmouthshire.

In May 1991, 175 tons of dressed stone from the recently demolished Cwmffrwdoer Primary School was donated to the campaign by Torfaen Borough Council.

This scheme has been financed by the European Regional Development Fund, Torfaen Borough, Croft Pontypool, Gwent County Council, The Prince of Wales' Committee"Access to the Folly Tower is via a field which is part of a working farm.