He served as the head football coach at Eastern New Mexico University from 1983 to 1984 and West Texas State University—now known as West Texas A&M University—from 1985 to 1987, compiling a career college football head coaching record of 31–20–2.
He played college football at the University of North Carolina at Chapel Hill from 1965 to 1969 as a wide receiver, running back, and kick returner.
From 1971 to 1974, Kelly was an assistant football coach at the University of Richmond, where he received his Juris Doctor degree.
Kelly was an assistant football coach at Snow College under Dave Arslanian in 1979 and 1980.
Kelly practiced as a family and criminal defense attorney in Canyon, Texas.