[2] Vann enrolled at the United States Military Academy at West Point, New York, in 1951.

He was Army's quarterback from 1952 to 1954, playing under head coach Earl Blaik and offensive coordinator Vince Lombardi (through the 1953 season).

[3] As a junior, Vann led the 1953 Army Cadets football team to the Lambert Trophy with a 7–1–1 record.

[3] He received second-team honors from the Associated Press (AP) and International News Service on the 1953 All-Eastern football team.

[9] The Detroit Free Press wrote: "Pete Vann ... was the brightest star in the Army line-up.

"[10] Michigan head coach Bennie Oosterbaan said: "Vann is as good a quarterback as we will see this season.