[2] In 2017, the summer before his freshman year, the Baldwin family moved to Wisconsin, because his father became the head men's basketball coach at the University of Wisconsin–Milwaukee.

[3] During his freshman year he was part of their 2017–18 team that made the state tournament, losing to future NBA All–Star Tyrese Haliburton and Oshkosh North 57–56 in the final.

[4] As a junior, Baldwin averaged 24.3 points and 10.8 rebounds per game, earning Wisconsin Gatorade Player of the Year honors.

On May 12, 2021, he committed to playing college basketball for Milwaukee under the coaching of his father over offers from Duke, Arizona State, Iowa, Kansas, Kentucky, LSU, Michigan, North Carolina, USC and Georgetown.

He also played the next two conference games against Cleveland State and Northern Kentucky, averaging 30 minutes and 6.5 points while shooting 4-of-19 overall (1-of-11 from 3), before sitting out the rest of the season for undisclosed reasons.

On December 21, 2022, Baldwin scored a career high of 17 points in a 143–113 blowout loss to the Brooklyn Nets, shooting 6-of-10 overall and 5-of-8 from three in 23 minutes of play.

[20] On July 6, 2023, the Warriors traded Baldwin, Jordan Poole, Ryan Rollins and draft picks to the Washington Wizards in exchange for Chris Paul.

His father, Pat, was a standout college basketball player at Northwestern, then was head coach at Milwaukee and is currently an assistant at Valparaiso.