The family were descended from Sir William Graham lord of Kincadaine and his wife Lady Mary Stewart m. 1406, daughter of King Robert III of Scotland.
Their eldest son Sir Robert was titled of Fintry in Stirlingshire, they later swopped these lands for those held by their cousins in Angus.
He was married to Margaret, daughter of Sir James Scrymgeour Viscount Dudhope and Scottish Royalist and the family spent a large part of their wealth in support of the Stewarts.
James Graham, 9th of Fintry was offered a knighthood by King Charles II, which he refused, the prefix of "Sir" in the seventeenth century had no attraction for the great barons of Scotland.
He was lieutenant-colonel of the Angus regiment and he married Anne daughter of Colonel George Hay grandfather of Andrew 11th Earl of Erroll and a noted Royalist.