James Duff, 5th Earl Fife, KT (6 July 1814 – 7 August 1879) was a Scottish nobleman and politician.

He succeeded as the 5th Earl Fife, 5th Baron Braco of Kilbryde, and 5th Viscount MacDuff on 9 March 1857, and inherited many baronies including MacDuff, named for James Duff, 2nd Earl Fife.

[4] In 1845, Duff resided at 30 Pall Mall, London and at Delgatie Castle.

[5] On 16 March 1846, he married Lady Agnes Georgiana Elizabeth Hay, daughter of William Hay, 18th Earl of Erroll and Lady Elizabeth FitzClarence (an illegitimate daughter of William IV).

Together, they were the parents of five children, including:[6] Lord Fife died on 7 August 1879.