He attended Alexandria High School then entered The United States Military Academy at West Point for one semester to placate one parent.
[5] In 1944, Summers took a brief hiatus from college athletics to serve with the American Red Cross during World War II.
[3] He had previously attempted to join the military three times, but was rejected on all occasions due to physical reasons.
He then returned to Staunton Military where he coached the school in three sports for ten years, and went on to become its athletic director.
[4] Summers later returned to his alma mater where he served two stints as a VMI head coach in three sports, from 1934 to 1936 and again in the late 1940s.