Le Deux grew up in Nagambie and attended Assumption College, after which he went to Bendigo to study teaching.
[2][3] While a student at Bendigo Teachers' Training College, Le Deux played for the Sandhurst Football Club.
[2][4] He then moved to Ocean Grove to take up a teaching position and in 1956 joined Geelong.
[7][8] In 1960 he joined Victorian Football Association club Mordialloc, as he had transferred to a local technical school.
[8] Le Deux's daughter Jennifer was married to former Geelong player Jack Hawkins.