His mother succeeded to a large part of the Ancaster estates in 1779, to the barony of Willoughby of Eresby in 1780 and to the hereditary office of Lord Great Chamberlain.

[2] On 29 June 1820, he succeeded his father as 2nd Baron Gwydyr, 3rd Baronet Burell of Knipp and Deputy Lord Great Chamberlain.

On 29 December 1828, he succeeded his mother as 22nd Baron Willoughby de Eresby and joint (1/2) hereditary Lord Great Chamberlain.

The canopied tomb of their second daughter, Elizabeth Susan (d. 1853) is adjacent, and those of their son Albyric (d. 1870) and grandson Gilbert Heathcote-Drummond-Willoughby, 1st Earl of Ancaster (d. 1910), are nearby.

[5][6][7] Gwydyr Mansions in Hove, East Sussex, were named after him in honour of his friendship with the Goldsmid family, upon whose land the development was built in 1890.