The house was set in a park of some 340 acres (1.4 km2) created by Capability Brown and including a large serpentine lake.
The Pigot family sold the property to William Legge, 5th Earl of Dartmouth in 1848, whose son and heir Viscount Lewisham took residence.
In 1990 the estate was broken up and many acres were sold for the creation of a golf course; a classical temple created by Capability Brown was converted to become the clubhouse.
In 1996 the house had suffered extensive decay and had deteriorated so badly that it appeared on the English heritage list of Buildings at Risk.
Patshull Hall was bought in 1997 by Neil Avery, a renovation specialist and entrepreneur, as a restoration project and the house was subsequently removed from the Buildings at Risk register.