His promising political career ended in disgrace when he was caught having sex with a guardsman in St James's Park.

[citation needed] During the Second World War he served in the anti-aircraft arm of the Royal Artillery, becoming the Adjutant of 123 Light Antiaircraft Regiment Royal Artillery in 1940 and the Brigade Major of 33 AA Brigade RA in 1943, before serving on the staff of HQ AA Command in 1944.

[citation needed] After the War he served as lieutenant colonel commanding 566 LAA Regiment RA (City of London Rifles) from 1947 to 1950.

Harvey first stood as a Conservative Party Parliamentary candidate for the seat of Spelthorne in Middlesex at the 1945 general election, but was defeated.

[3] He was a member of a House Select Committee that recommended "draconian punishments for practising homosexuals in the armed forces".

[7] Harvey subsequently resigned his ministerial post and his seat, forcing a by-election early in 1959, in which he was succeeded by Conservative Anthony Courtney.