The town introduced a set of by-laws for the park in 1913 which included controls against private business use, impact to wildlife, firearms, alcohol, profanity and speed limits of vehicles.
In 2010, WorldCan Inc., a New Brunswick-based company which was a franchise operator for Quebec-based TreeGo, contacted the town to propose locating an aerial adventure business within Victoria Park in the Lepper Brook gorge.
; one locally-famous route to vantage points above the waterfalls is "Jacob's Ladder", a wood staircase comprising 175 steps up the side of the gorge.
Several crushed gravel multi-use bicycle and walking paths have been graded on more gently sloped areas in the forested part of the park and are groomed for nordic skiing in the winter season.
The northern edge of the park bounded by Adams Street is a flat open area in a protected valley that has been developed with the following facilities: