The son of James Kaye and Elizabeth Thoroton, he was born at Potters Bar in December 1861.
[5] Playing as a wicket-keeper and opening batsman, he was dismissed for 3 runs in Hampshire's first innings by Wilfred Flowers, while in their second innings he was dismissed for 11 runs by Arnold Rylott; as wicket-keeper, he made a single stumping.
He served in the Mahdist War in 1885, surviving the siege at Suakin, for which he was decorated with the Khedive's Star.
[8] Kaye transferred from active military service in 1889, joining the Indian Political Service (IPS); upon his appointment in the IPS, he volunteered with the 1st Central India Horse from 1890,[1] in which promotion to captain came in September 1893 and major in July 1901.
[1] Kaye returned to military service with the Censor's Department during the First World War,[1] with him holding the rank of lieutenant colonel by 1916.