Herz played baseball, basketball and football at Terry Sanford High School in Fayetteville, North Carolina.

He considered walking on to the football team at North Carolina until Sam Howell committed to play for the Tar Heels.

[10] Herz split the 2022 campaign between South Bend and the Double–A Tennessee Smokies, accumulating a 3–6 record and 4.25 ERA with 141 strikeouts across 26 starts.

[11] On July 31, 2023, Herz and Kevin Made were traded to the Washington Nationals in exchange for Jeimer Candelario.

With the start, he became the first pitcher since Stephen Strasburg, and the second since 1901, to record 13 strikeouts without walking a batter in one his first three major league appearances.