Grimm attended Southmoreland High School, playing both quarterback and linebacker there, while also serving as the team's punter.

After high school, Grimm accepted a scholarship to play college football at the University of Pittsburgh as a linebacker.

Despite never playing on the offensive line before, Grimm decided to convert to center because the team was lacking sufficient players at that position.

Those two years of 1979 and 1980 were among the best in school history, as the team posted a 22–2 record over that span and barely missed out on playing for the national championship both times.

Along with Jeff Bostic, Mark May, George Starke and Joe Jacoby, Russ Grimm was a founding member of the Redskins' renowned "Hogs" offensive line of the 1980s and early 1990s (deemed one of the best front fives of NFL history), which was a mainstay of the Redskins' glory years during the first Joe Gibbs era.

"[3] According to Mark May, a teammate both at Pittsburgh and on the Redskins, no one lived up to the "Hog" persona more than Grimm: "He was a blue collar stiff and proud of it.

"[4]: 57  In his 2005 memoir, May recalled a Christmas party at his house in 1982: "I iced down a keg of beer and stationed it on the landing between the first floor and basement.

In 2006, the Steelers' offensive line helped pave the way for running back Willie Parker to gain 1,494 yards and 13 touchdowns on 337 carries with 4.4-yard avg.

In the press conference that followed, Steelers' president Art Rooney II announced Grimm as one of the candidates for the job.

Grimm's offensive line also paved the way for running back Edgerrin James to rush for 1,222 yards, the fifth-best total in team history.

[8] After the Arizona Cardinals hired Whisenhunt as their new head coach, on January 14, 2007, the finalists for the Steelers position were reduced to Grimm and Minnesota Vikings defensive coordinator Mike Tomlin.

A day earlier, ESPN and Sports Illustrated stated on their web sites that Tomlin had been chosen to replace Cowher.

However, the Tribune-Review claimed that an unnamed "NFL source" said that on January 21, 2007, Tomlin had not heard from the Steelers and no contract negotiations had taken place.

Grimm was one of three finalists to replace Cowher, along with Tomlin and Chicago Bears defensive coordinator Ron Rivera.

His younger brother, Donn, was a starting linebacker on Notre Dame 1988 national championship team and signed with the Cardinals as a rookie free agent in 1991.