Their father was Robert Sumner, and their mother was Hannah Bird, a first cousin of William Wilberforce.

In 1820, George IV wished to appoint him as a canon of Windsor, but the prime minister, Robert Jenkinson, 2nd Earl of Liverpool, objected; Sumner received instead a royal chaplaincy and librarianship.

In 1869 he resigned his seat, but continued to live at the official residence in Farnham until his death on 15 August 1874.

[4] Sumner published a number of charges and sermons and The Ministerial Character of Christ Practically Considered (London, 1824).

[3] Sumner married Jennie Fanny Barnabine Maunoir (23 February 1794 – 3 September 1849) and had seven children - four sons and three daughters,[5] including: