The manor house was constructed in the 17th century at least, standing about half a mile to the west of the parish church, north of Park Road.

[1] The last house to stand on the site is believed to have been built in the early part of the 19th century by the Sir John Gibbons, 2nd Baronet, who owned the manorial rights from 1754 to 1933.

[2][3] The last of the Gibbons family to live there sold Stanwell Place to a civil engineer, Sir John Watson Gibson, in 1933.

[4] During the Second World War, Gibson, as deputy director-general civil engineering (special) at the Ministry of Supply (1943–44), was one of the principal people responsible for the construction of the top secret Mulberry Harbours.

It was as a result of this that he lent Stanwell Place to the SHAEF Commanders, and they held two top level meetings there during the buildup to D-Day and the Normandy Invasion.