Spencer started his league career in 1948 and the following season topped North Melbourne's goalkicking for the first of seven times with 65 goals.

A consistent performer up forward, Spencer topped the club's goalkicking every season to 1956 with the exception of 1953 when he only managed to play four games.

The record was equaled in 1981 by Malcolm Blight and passed by John Longmire in 1990.

[2] Spencer regularly represented Victoria at interstate level, most notably at the 1956 Perth Carnival where he was the leading goalkicker with 17 goals.

His final league tally of 475 goals was a club record until surpassed by John Longmire during the 1990s.