[1] Frazier played college football at Alcorn State University from 1978 to 1980, where he lined up in the defensive secondary next to Roynell Young.

Frazier's junior season was cut short by a torn hamstring injury, but he still put up 5 interceptions and 49 tackles.

At the end of the year, Frazier decided to skip his senior season and declare for the NFL draft.

His playing career was cut short due to a knee injury he suffered returning a punt in the second quarter of the Super Bowl.

It was there that Frazier worked as a fellow assistant with the Vikings future head coach, Brad Childress.

In 2003, Frazier was hired as defensive coordinator of the Cincinnati Bengals under new head coach Marvin Lewis where he helped turn the unit into a group that increased takeaways from 24 in 2003 to 36 in 2004.

The Bengals' defense improved from 28th in the league in total yards allowed in 2003 to 19th in 2004, and declined in the two years following his dismissal.

On February 4, 2007, the Colts beat Frazier's former team, the Chicago Bears, in Super Bowl XLI.

[5] Frazier ended the 2010 season with a loss to the Detroit Lions, putting the Vikings in last place in the NFC North.

On January 3, 2011, the Vikings and Frazier reached an agreement making him the permanent head coach.

[6] In Frazier's second full year as head coach, the Vikings improved to 10–6, making the playoffs.

[7] The biggest single-season turn around in Vikings history resulted in Frazier finishing fourth in voting for the NFL Coach of the Year Award and the Vikings exercising their fourth year team option to keep Frazier under contract through 2014.

Frazier was nearly hired by the Giants in 2022 before the job was eventually won by former Buffalo Bills offensive coordinator Brian Daboll on January 28, 2022.