[3][2] Boxing as a novice, Anderson won the North London Divisional Championships as bantamweight.
[2] In May 1964 British Amateur Boxing Association Championships Anderson, now at light-welterweight, defeated the Scottish boxer and Olympic medallist Dick McTaggart in the semi-final, but was controversially beaten by Robert Taylor in the final.
[3][2][4] Anderson was selected for the English boxing team for an international match in Hungary in August 1964, and won both his bouts, including one against the Olympian Istvan Toth.
[2] However, just a month before the Games, Anderson was chosen for the Irish Olympic Team to replace the injured light-welterweight Jim Neill.
[3][6][1] His close friend Jim McCourt won a bronze medal, with Anderson and team coach Harry Enright in his corner.