The eldest son of George Grey of West Ord, near Berwick-on-Tweed, who died in 1793, by Mary, daughter of John Burn of Berwick, he was born at Millfield Hill, Glendale, Northumberland, in August 1785, and was educated at Richmond grammar school.

While still young he met Francis Jeffrey, Thomas Chalmers, Edward Irving, and Sir Walter Scott, and entered public life when seventeen years old.

[1] In 1833 Sir James Graham placed under Grey's sole management the northern estates belonging to Greenwich Hospital in Northumberland and Cumberland.

Grey then ceased to take an active part in politics; but was consulted on some measures, such as the Tithe Commutation Act, the land drainage scheme, and free trade.

[1] In the administration of the agricultural and mining estates of Greenwich Hospital, Grey was raised the net rental of the property in twenty years from £30,000 to £40,000.