The grounds were purchased by the local authority in 1920, while the estate house was leased, and later sold, to the Sisters of the Holy Ghost to become St. Alban's RC High School.

The grounds contain a number of structures including a double ice house, the Folly Tower and the Shell Grotto.

[3] The Pontymoile Gates, which now stand at the entrance to the park, were a gift from Sarah, and originally stood between Hanbury's house and the stables, before being moved to their present position in around 1835.

Archdeacon Coxe stayed during his Welsh tours in 1799-1800, and described a visit to the tower in the company of Hanbury-Leigh and his wife: "From this eminence, the wild and fertile parts of Monmouthshire are beautifully combined.

[5] The stables, which now house the Torfaen Museum, are listed Grade II* on Cadw's historic buildings record.

There are landscaped areas such as the Italian Gardens (refurbished in 2006) and the Nant-y-Gollen Ponds (originally one large millpond used to power a forge downstream).

Originally constructed by John Hanbury in 1762, it was demolished during the Second World War, after fears that it would act as a marker for German aircraft.

[17] The interior is decorated with shells and bones, reputedly the work of Hanbury Leigh's first wife, Molly Mackworth.

[19] A second set of gates into the Italian Gardens at the southern edge of the park forms the town's war memorial.

There is also a bandstand that forms part of the venue (along with nearby Torfaen Museum) for the annual Jazz in the Park festival.