On 4 December the same year he was commissioned in the same rank into the 2nd Battalion, King's Own (1st Staffordshire) Militia.

He later received the honorary rank of lieutenant-colonel and was second-in-command of the regiment, retiring on 30 November 1901.

[1][4][5][6] Bagot also held the office of Gentleman Usher of the Privy Chamber from 1885 to 1887 and was a justice of the peace and deputy lieutenant for Derbyshire and Staffordshire.

[1] On 25 July 1903, Lord Bagot married the American Lilian Marie May (1863–1958) at Brompton Oratory.

[1][7][8][9] The couple separated shortly after the christening of their only child, a daughter:[10][11] Lord Bagot was an art collector and owned paintings by Sir Joshua Reynolds, Sir Peter Lely, Veronese, Albrecht Dürer, Anthony van Dyck, Bartolomé Esteban Murillo, Le Nain, Frans Hals, van Eyck, and valuable relics of the reign of King Charles I.