Bridget Cherry and Nikolaus Pevsner describe the house as "exquisite" and point out the "[b]eautiful doorway with Corinthian pilasters and a frieze carved with cherubs' heads and palm leaves" and the "[o]utstandingly fine wrought-iron gatepiers, gates and railings".

[5][6] A claim that the house was the honeymoon destination of George, Prince of Wales and Maria Fitzherbert on 15 December 1785, following their secret marriage, has not been substantiated.

[10] Their youngest son Felix, who was killed in action in 1914 is commemorated on a memorial in nearby St Andrew's Church, Ham.

[5] The house's link to the Earls of Dysart, to whom Townshend, Sinclair and Hanbury-Tracy had all been connected by marriage, was broken in 1949 when the Tollemache family auctioned the Ham estates.

Lee held a loan exhibition entitled Masterpieces of British Art and Craftsmanship in the house in 1954, which was attended by The Queen Mother.