Spencer previously served as the defensive coordinator and safeties coach at the University of South Florida.
He left Georgia Tech to accept a position on former college teammate Ted Roof's inaugural staff at Duke.
[5] Following his termination from Oklahoma State, Spencer was hired by Charlotte as the defensive coordinator and linebackers coach for the 2018 season.
[6][2] During his lone season at Charlotte, the 49ers only had a 5–7 record despite Spencer's defense being in the top 25 in terms of yards allowed.
Spencer was named to Lane Kiffin's staff at Florida Atlantic to serve as the defensive coordinator and linebackers coach for the 2019 season.
[11] On November 21, 2021, Spencer was fired by head coach Jeff Scott after posting a bottom 10 defense in all of FBS for the 2021 season.