He served as Captain of the Honourable Corps of Gentlemen Pensioners under Lord Grey between 1830 and 1833.

When the Whigs came to power under Lord Grey in 1830, Foley was appointed Captain of the Honourable Corps of Gentlemen Pensioners, a post he held until his early death in 1833.

[2] Apart from his political career he was also Lieutenant-Colonel Commandant of the West Worcester Local Militia from 24 September 1808,[3][4] Lord Lieutenant of Worcestershire between 1831 and 1833 and Master of the Quorn Hunt from 1805 to 1806.

Lord Foley married Lady Cecilia Olivia Geraldine FitzGerald (3 March 1786 – London, 27 July 1863), daughter of William FitzGerald, 2nd Duke of Leinster, in Boyle Farm, Kingston upon Thames, on 18 August 1806.

They had four sons, and four daughters: He died in London in April 1833, aged 52, he was succeeded in the barony by his son, Thomas, who also succeeded him as chief whip in the Whig government.