Budde graduated from Midwest City High School in Oklahoma and entered the 1998 Major League Baseball Draft.

Budde began his professional career in 2002, playing for the High-A Rancho Cucamonga Quakes and the Double-A Arkansas Travelers.

On December 7, 2006, Budde was selected by the Philadelphia Phillies in the major league phase of the Rule 5 Draft.

Upon receiving him back, the Angels assigned Budde to Triple-A to play with the Salt Lake Bees.

On July 28, 2007, Budde's contract was purchased to give the Angels a second catcher after Mike Napoli was placed on the disabled list.

On December 21, 2010, the Toronto Blue Jays signed Budde to a minor league contract with an invitation to spring training.