Together with his wife Andrée Brunet he won Olympic medals in 1924, 1928 and 1932, as well as four world titles between 1926 and 1932 in pair skating.

He also competed in singles, winning the national title in 1924–1931 and finishing seventh-eighth at the 1924 and 1928 Winter Olympics.

[citation needed] The pair won four World Championships, competing in alternate years.

Joly and Brunet were the first French skaters to win gold medals in World, European, and Olympic competitions.

[3] They then became coaches, and trained future Olympic champions Carol Heiss and Scott Hamilton.