[2] The grounds of Albury Park were laid out by John Evelyn, the 17th-century diarist and landscape gardener, between 1655 and 1677.

John Evelyn's work included a yew walk, a vineyard, a terrace a quarter of a mile long, and a 160-yard tunnel, through the hill under Silver Wood.

He also designed a wide canal fed by the River Tillingbourne; it was drained in the early nineteenth century.

In 1800, Captain Finch's widow sold the estate to Samuel Thornton, who made additions to the house, including the north front, to the designs of John Soane.

[8] Drummond added a battlemented stone Gothick tower at the north-west corner of the building,[4] and 63 brick chimneys – each to a different design.

The private areas of the park contain a Roman bath and a cave inspired by the Grotto of Posilippo in Naples.

The building was converted into private flats that were owned by the Country Houses Association until it went into liquidation in 2003.

Albury Park was featured in a Channel 4 television series, Country House Rescue in December 2008, and November 2009.

[14] In March 2020, Country Life reported that the Grade II* listed mansion had been split into luxury apartments.