[2] Following his playing career, Klemm began coaching at Southern Methodist University in 2008 as a graduate assistant and being promoted to be their offensive line coach in 2009 and serving in that position for four seasons before serving in the same position at UCLA from 2012 to 2016.
In 2009, Klemm was named the offensive line coach and in 2011, he added the title of recruiting coordinator for the Mustangs.
[5] In December 2011, Klemm accepted an offer to become the offensive line coach and run game coordinator for the UCLA Bruins under coach Jim L. Mora He helped the Bruins bring in one of the nation's top recruiting classes and was named the Pac-12 Recruiter of the Year by 24/7 Sports.
[10] On December 27, 2021, Klemm left the Steelers with 2 games remaining in the regular season to become an offensive line coach at Oregon.
The offensive line led the FBS in sacks allowed with only five, and the Ducks rushing game was rated the twelfth best.
[4] Klemm was one of the candidates interviewed by the New England Patriots in January 2023 as part of their search for a new offensive coordinator.
[4] On February 6, Klemm was instead hired by the Patriots as the offensive line coach to complement O'Brien.