While attending Cedar Cliff in Camp Hill, Pennsylvania, Brady lettered in football, basketball, and baseball.

At Penn State, Brady was a two-time All-Big Ten selection, and a consensus All-America choice as a senior, catching 27 passes for 365 yards and 2 touchdowns.

During his senior year in 1994, he helped his team to an undefeated record, a conference championship, and the school's first Rose Bowl victory.

Although Paterno continued to push for back up TE Chiefa, he was ranked seventh in the all-time reception list for the school.

After Brady was announced, Joe Theismann said "It just doesn't seem to make sense", speculating that Rich Kotite wanted two tight ends on the field.

Brady had a reputation with the Jags as a very durable player, having only missed nine games in his twelve seasons in the NFL, and was also known as an outstanding blocker.

His reputation as a durable blocker helped him to land a two-year contract on March 3, 2007, with the New England Patriots to replace departing free agent Daniel Graham at tight end.

"[9] Despite nagging injuries, Brady played in 14 games for the Patriots in 2007, catching nine passes for 70 yards and two touchdowns,[10] culminating with Super Bowl XLII.

[19] On March 21, 2009, he threw out the first pitch at opening day ceremonies for the Green Cove Springs Athletic Association Little League Baseball.