That year Grey became Governor of Northern Ireland during the period of civil rights marches and increasing levels of street violence.

In the depths of an economic recession, local government was suspended; Northern Ireland was subjected to Direct Rule from Westminster, and Lord Grey of Naunton was recalled.

[8] When the post was abolished in 1973, he was promoted Knight Grand Cross of the Royal Victorian Order (GCVO).

[9] At the same time, he was Knight Commander of Ards, then Bailiff of Egle from 1975, until appointment as Lord Prior of the Most Venerable Order of the Hospital of Saint John of Jerusalem (1988–91).

Grey was a Council member of Cheltenham Ladies College, where his daughter, Amanda, was educated.

Lord Grey served as Chairman of the Central Council of the Royal Overseas League (1976–81).

In 1944 he married Esme Mae, daughter of Albert Victor Kerry Burcher, of Remuera, Auckland (and widow of Pilot Officer Kenneth Kirkaldie, REFVR).

The couple had three children: The Grey family lived in Gloucestershire among the rolling Cotswold hills at Overbrook in the village of Naunton, which provided the territorial designation of his peerage title.