Rumph moved often during his early life due his father's career as a football coach.

He moved to Gainesville, Florida and transferred to Buchholz High School before his sophomore year.

Rumph committed to play college football at Duke over offers from UCF, Vanderbilt, and Appalachian State.

[4] Rumph posted 47 tackles, 13.5 tackles for loss, 6.5 sacks, three pass breakups, 11 quarterback hurries and one forced fumble and was named third-team All-Atlantic Coast Conference (ACC) and First-team All-America by Pro Football Focus and Second-team All-America by Sports Illustrated.

[5][6][7] Rumph was selected by the Los Angeles Chargers in the fourth round, 118th overall, of the 2021 NFL draft.