[2] After leaving MSU, Carmody joined Bill Dooley's staff at North Carolina and served as an assistant coach for seven seasons (1967–1973).
[2] He then served on Ken Cooper's staff at Ole Miss from 1974 to 1977, Bobby Collins' staff at Southern Miss as defensive coordinator from 1978 to 1980 (where he earned the nickname "The Big Nasty" as coordinator of the "Nasty Bunch")[3][4] and made a stop in the National Football League with the Buffalo Bills as an assistant coach in 1981.
[6] During Carmody's tenure, the Golden Eagles defeated Alabama, 38–29, in Tuscaloosa in 1982, snapping the Crimson Tide's 56-game home winning streak at Bryant–Denny Stadium.
[10] In 1984, Southern Miss, already under NCAA sanctions for prior infractions, admitted to improper recruiting practices pertaining to freshman linebacker Don Palmer.
[11] After leaving Southern Miss, Carmody returned to Mississippi State to serve as defensive coordinator under head coach Rockey Felker, a position he held during the 1989 and 1990 seasons.