Stump graduated from Saint Mary's High School in his native Lansing, Michigan, and signed with the Tigers in 1951.

His first two minor league seasons — sandwiched around a two-year military stint during the Korean War — were noteworthy, as he won 30 of 43 decisions (.698).

After winning 14 games for the 1957 Birmingham Barons of the Double-A Southern Association, Stump made his Major League debut for the Tigers against the Boston Red Sox at Briggs Stadium, working one inning in relief and giving up a hit, a run and two bases on balls, including one to Ted Williams, in a 6–1 Tiger defeat.

The next two seasons, Stump put up identical 8–11 records with the Triple-A Charleston Senators, before receiving his second and final audition with the Tigers in 1959, pitching in 111⁄3 innings and posting another strong ERA (2.38).

[2] During his two MLB trials, Stump worked in 242⁄3 innings pitched; he allowed 23 hits and 12 bases on balls, but only seven runs, six of them earned, for a career ERA of 2.19.