Stump was born in Parkersburg, West Virginia,[1] spent his early life there and was appointed to the United States Naval Academy in 1913.

Shortly thereafter Stump attended flight training at the Naval Air Station Pensacola in 1920-1921 followed by postgraduate instruction in Aeronautical Engineering at the Massachusetts Institute of Technology.

Following action at Saipan, Stump retained commanded Carrier Division 24 but was now assigned to Task Unit 77.4.2 (Taffy II).

From December 1948 to 1951 Stump served as commander of Naval Air Forces Atlantic Fleet, during which time he was promoted to vice admiral.

After his retirement, he was appointed to the position of Vice Chairman of Directors and Chief Executive Officer of Freedoms Foundation at Valley Forge, Pennsylvania.