[1] Gordon was born at Bourne Place, Bexley, Kent,[2] the second son of Hon.

Dudley Gordon and Cécile Elizabeth, daughter of George James Drummond.

He was baptised at the Bexley parish church at six week old;[3] Queen Mary was his godmother.

From that point his father was styled Lord Dudley Gordon until he succeeded his elder brother as 3rd Marquess of Aberdeen and Temair in 1965.

He was succeeded in the marquessate, and his other titles, by his younger brother Lord Alastair Gordon.