Raised to peerage as Viscount Althorp in 1905, he was Lord Chamberlain from 1905 to 1912 in the Liberal administrations headed by Sir Henry Campbell-Bannerman and H. H. Asquith.

In 1892, he was sworn of the Privy Council[4] and appointed Vice-Chamberlain of the Household under William Ewart Gladstone,[5] a post he held until 1895, the last year under the premiership of Lord Rosebery.

[7] On 19 December 1905, Spencer was created Viscount Althorp, of Great Brington in the County of Northampton,[8] to allow him to become Lord Chamberlain in Sir Henry Campbell-Bannerman's new Liberal administration.

[15] Lord Spencer died in September 1922 at his home in St James Place, London, aged 64.

Lord Spencer was buried next to his wife in Saint Mary the Virgin with St John Churchyard, Great Brington, Northamptonshire.