It was created in 1602 for Edward Bruce, later Master of the Rolls, with remainder to his heirs and assigns whatsoever.
In 1641 he was also created Baron Bruce (designated "of Whorlton in the County of York") in the Peerage of England.
In 1746 he was given the additional title of Baron Bruce (designated "of Tottenham in the County of Wilts") with remainder to the Hon.
The Tottenham barony of Bruce passed according to the special remainder to his nephew Thomas, the second Baron.
However, in 1868 the Committee for Privileges of the House of Lords decided that the rightful heir to the title was James Brydges, 3rd Duke of Chandos, as the son of Lady Mary Bruce, daughter of the fourth Earl of Elgin.
The heir to the lordship of Kinloss was his only child, Anne, Duchess of Buckingham and Chandos and de jure eighth Lady Kinloss, the wife of Richard Temple-Grenville, 1st Duke of Buckingham and Chandos.