Originally a private residence, Urchfont Manor was used to house evacuated children during the Second World War.
Pitt kept the Somerset estates at Burton Pynsent but sold his new property at Urchfont to the third Duke of Queensberry, and the house was then occupied by tenants until it was bought by Simon Watson Taylor in 1843.
[2] In 1928, his heirs sold the house and what remained of its farmland to Hamilton Rivers Pollock (1884–1941), a barrister who lived there until his death.
In 1945, the house and about 100 acres of land were bought by Wiltshire County Council to establish an adult education centre, which opened in 1947.
Professor Mick Aston described it as a notable example of Flemish brickwork in the Channel 4 programme Time Team.