The Charing Cross to Tonbridge railway line was in the process of construction and the purchase enabled him to combine his London career with his ambition to be a country landowner.

He and his wife, Sarah, had ten children (4 sons and 6 daughters) and a large staff of servants and gardeners to maintain the house.

He played an important role in local affairs, being the first Chairman of the Hildenborough Parish Council when it was formed in 1894 and a churchwarden from 1869 until his death in 1907.

In 1912 the estate was sold to Barnett Lewis, a wealthy diamond merchant, who installed oak panelling in several of the reception rooms.

On his death in 1929, the property was damaged only to be refurbished by Herbert Rae, whose wife's coat of arms is on the fireplace in the entrance hall.