[1] Born and raised in Southern California, Norton graduated from Fullerton Union High School in 1956 and played college football for head coach Skip Stahley at Idaho, alongside future pros Jerry Kramer, Wayne Walker, and Jim Prestel in the Pacific Coast Conference.

Nicknamed "Flamingo," Norton played defensive back and tight end, and also punted and returned kicks for the Vandals.

While nursing a slim half-game lead in the Eastern Division in Week 12 of the 1962 AFL season, Norton personally tormented Denver Broncos quarterback Frank Tripucka.

He stopped three Bronco drives with interceptions as the Oilers stole a 34–17 victory and a berth in their third straight AFL Championship Game.

The Oilers/Titans later retired the numbers of Elvin Bethea, Earl Campbell, Mike Munchak, Bruce Matthews, Warren Moon, Steve McNair, and Eddie George.