He was educated at the Garrison School in Aldershot[2] before enlisting into the Royal Engineers as a bugler[3] in 1912 before being commissioned into the Middlesex Regiment during World War I.

[2][5] He was 20 years old, and an acting British Army Captain in the 2nd Battalion, The Middlesex Regiment (Duke of Cambridge's Own), during the First World War when the following deed took place for which he was awarded the VC.

On 25 March 1918 at Eterpigny Ridge, France, Captain Toye displayed conspicuous bravery and fine leadership.

From 1925 to 1932 he was chief instructor at the Royal Egyptian Military College and Commandant of War Office Schools of Chemical Warfare 1940- 1942.

[2][8] On 25 March 2018, on the 100th anniversary of the action in which he won his Victoria Cross during World War I, a memorial to Toye was unveiled in the Municipal Gardens in his native Aldershot.