Charlton played college football for the University of Florida, and received All-American honors.
[3] He was a member of the Gators' best-in-the-Southeastern Conference (SEC) football teams that posted identical 9–1–1 overall win–loss records in 1984 and 1985.
[3] Charlton's fifteen forced fumbles, forty-nine career tackles for a loss and twenty-five quarterback sacks still rank first, fifth and fourth, respectively, on the Gators' all-time career records lists.
[3] Charlton graduated from the University of Florida with a bachelor's degree in psychology in 1988.
Charlton was selected by the Cleveland Browns in the first round of the 1988 NFL Draft with the 21st overall pick.