[3] On his grand tour of Europe, he passed through Rome, where he was painted by Pompeo Batoni in 1765–66, wearing the uniform of the 105th but with his tartan arranged like a toga.

In 1775, Marlborough obtained for him an appointment as Groom of the Bedchamber to King George III, whom he served until 1812; Gordon was returned again for Heytesbury at the ensuing by-election.

The Duke had offered to raise a new regiment for the King, with the intent of bestowing the colonelcy upon his brother, Lord William Gordon.

King George objected, however, to Lord William, who had disgraced himself by eloping with and then abandoning Lady Sarah Bunbury.

Gordon of Fyvie seized the opportunity to write to Lord Germain to request the colonelcy, assuring him of his nephew's support.

However, the Duke discovered that Gordon of Fyvie had already chosen the officers of the regiment and written to them before he even knew if he would get the command; and the appointments, he thought, were arranged so as to threaten his electoral influence in Aberdeenshire.