A native of Fort Towson, Oklahoma, he attended Midland High School in Texas.

[1] He played college football for the Rice Owls and was named by the Associated Press (AP) to the 1942 Sophomore All-Star Team.

[2] He was a member of the 1946 Rice Owls football team that won the Southwest Conference championship and defeated Tennessee in the 1947 Orange Bowl.

[3] In Rice's 1946 upset over unbeaten Texas, Williams caught two touchdown passes, including the game-winning touchdown on a play that became known as the "Cyclone Fence Play" due to the dent created by Williams in the fence.

He appeared in a total of 26 AAFC games, five as a starter, and caught 52 passes for 626 yards and three touchdowns.