He was a member of the Brooklyn Dodgers in 1948 and the Cleveland Browns in 1949 before playing two seasons with the Green Bay Packers.

He then took a job as the offensive line coach for the Houston Oilers, who won the American Football League championship in 1961.

He is a member of Austin College's athletics hall of fame, and the school named its coaching lifetime achievement award after him.

[6] That left a number of former Brooklyn players available for other AAFC teams, and the Cleveland Browns signed Spencer.

[2][7] He was then traded to the Green Bay Packers of the NFL, where he played for two seasons and was the defensive captain before retiring due to an injury.

[8] Spencer was hired as an assistant coach for the Houston Oilers in the American Football League (AFL) in 1961.

[3] The Oilers, who were coached by fellow former Browns tackle Lou Rymkus when he joined, won the AFL championship that year.

[3] Led by quarterback Joe Namath, the Jets finished the 1968 regular season with an 11–3 record and beat the heavily favored Baltimore Colts to win Super Bowl III.

[3] Spencer became the offensive line coach for the NFL's St. Louis Cardinals in 1971 before taking a similar role in 1972 at the University of Kansas.

[13] The Fire disbanded after the season, however, and Spencer got a job as an assistant with the Kansas City Chiefs, where he coached for six years.