He played college football for Auburn University, and earned consensus All-American honors.
As a senior, he was a member of the undefeated 1993 Auburn Tigers football team, and was recognized as a consensus first-team All-American.
The Los Angeles Rams selected Gandy as the 15th overall pick (1st round) of the 1994 NFL draft.
After three seasons with the Saints, he was traded to the Atlanta Falcons on April 7, 2006, for safety Bryan Scott and a draft pick.
On October 7 against the Tennessee Titans, Gandy suffered a torn anterior cruciate ligament in his left knee, causing him to miss the remainder of the season.