Robert died in 1331, by which time the family held land in Northumberland, Durham, Cumberland, Norfolk and Sussex.
Next came, Sir Matthew Whitfield, of Whitfield Hall, High Sheriff of Northumberland who married Margaret, the daughter of Sir John de Lancaster, of Howgill and Rydall, a relative of William de Lancaster I.
His son, John Whitfield, living 1480 had married Ann, the only daughter of Sir William Hilton, of Hylton Castle.
Miles' son, Robert Whitfield, left Cumberland and settled at Wadhurst in Sussex, where he became an ironmaster.
His son Thomas Whitfield, who was born about mid 1545, studied at Oxford University and at the Inner Temple, qualifying as an advocate.