Upon his father's death, Anson abandoned law and began the first of many travels to the continent, as was then the fashion for young men of fortune and taste.

In 1732 Anson and his friend the Earl of Sandwich formed a riotous dining-club called the Society of the Dilettanti, which also had the more serious purpose of encouraging study of Greek architecture.

In Paris he bought crayons for his friend the Duchess of Bedford, and his sister-in-law, Lady Anson, sent him a long list of presents she desired.

Anson and another member of the Society of the Diletantti rebuilt the house in the Greek revival style that the pair were championing in England.

The park was strewn with temples and follies, including the mysterious Shepherd's Monument, the Pagoda, Pigeon House and the Tower of the Winds.