According to legend, in August heading into his senior year, Crump was arrested by the authorities of Lexington, Virginia, for running naked through the town, the United States' first recorded incident of streaking.
Crump would later serve as member of the Nineteenth Congress of the United States as a Jacksonian Democrat, filling a vacancy caused by the resignation of John Randolph.
He was unsuccessful in his bid for reelection in 1826 election to the 20th United States Congress and left public life for a time.
He was later appointed by President Andrew Jackson as chief clerk of the Pension Bureau in 1832.
He died on October 1, 1848, in Powhatan County, Virginia,[4] and is interred on his home's grounds at "Log Castle" on Swift Creek, Chesterfield County, near Colonial House, Virginia.