In 2018, Westburg's freshman year with the Mississippi State Bulldogs, he appeared in 42 games (making 31 starts) in which he batted .248 with two home runs and thirty RBIs.

[11] He earned Southeastern Conference Player of the Week in March, batting .476 with two home runs and 11 RBIs over five games.

[26] After batting .247 with nine home runs and 32 RBIs over 47 games, he was promoted to the Norfolk Tides of the Triple-A International League in early June.

[31] He hit his first major league home run on July 24, 2023, against Philadelphia Phillies starter Cristopher Sanchez at Citizens Bank Park.

[32] Westburg began the 2024 season in the Orioles' opening day lineup as the designated hitter against the Angels, and recorded an RBI single.

In the bottom of the 11th inning, he hit a single on the first pitch of his at bat to score the runner from second base and end an extra-innings game with a 5-4 win.

[1] He went on the injured list after sustaining a fracture in his right hand when he was hit by a Yerry Rodríguez pitch in the fifth inning of a 10–4 home win over the Toronto Blue Jays on July 31.