At the southern end of the park is Towneley Hall, a grade I listed building housing Burnley's art gallery and museum.

[2] The male line of the family died out in 1878 and in 1901 one of the daughters, Lady O'Hagan, sold the house together with 62 acres (250,000 m2) of land to Burnley Corporation for £17,600.

[5] The hall not only contains the 15th-century Whalley Abbey vestments, but also has its own chapel – with a finely carved altarpiece made in Antwerp around 1525.

[6] The art gallery contains important Victorian and Pre-Raphaelite works by Burne-Jones, Waterhouse, Alma-Tadema and Zoffany,[7] watercolours by Turner and local artist Noel H. Leaver, a collection of Lancashire furniture, the Whalley Abbey vestments, natural history and local social and military history relating to the Towneley family.

[10] According to writer Daniel Codd, there are later stories of a strange ghostly white apparition that appears by the River Calder.