[1] After graduating from high school in 1951, Walker was awarded an Elmer Gedeon scholarship to the University of Michigan.

The Gedeon scholarships, created in memory of a multi-sport student athlete who was killed in World War II, were awarded on the basis of "moral character, good citizenship, scholastic ability, and achievement, promise of leadership and success, and physical ability.

As a 192-pound sophomore in 1952,[2][3] Walker started nine games for the Wolverines and was named an All-Big Ten Conference player.

[4] In June 1953, Walker suffered a setback when he pleaded guilty in Ann Arbor Municipal Court to stealing gasoline from a parked car; Walker and another student admitted siphoning gas from a car parked behind a dormitory and paid fines totaling $16.25.

[4] Walker was flown to New York to receive the Look magazine award on The Jackie Gleason Show in December 1954.

[4] Walker was the first South Haven athlete ever to receive an All-American rating, and local residents honored him at a testimonial banquet in February 1955.

[10] Michigan's line coach Jack Blott spoke at the banquet, and Walker was given a set of luggage.

Walker told a reporter that he went to Canada because they offered more money than the NFL, and he had heard tales of salary troubles of Green Bay players.