It is situated in an eighteenth-century house ("Hollytrees"), which was used as a private residence until 1929, when it became a museum.
[2] The modern house was constructed in for Elizabeth Cornelisen, who had bought the site from Lessingham's executors and promptly tore down the existing structure in poor condition.
[2] She died soon after, bequeathing the house to her niece, Sarah Creffeild (née Webster),[1] who left it to her second husband Charles Gray.
The Rounds finally sold it to the Corporation of Colchester in 1922, a purchase paid for privately by Viscount Cowdray and his wife.
[1] The house is known as Hollytrees after two holly trees planted in the grounds by Charles Gray in 1729[1][2] and is now a museum serving the centre of Colchester and specialising in local history.