He is known for winning three NCAA championships at the University of Kentucky, and for being a central figure in the point shaving scandal that impacted American college basketball in the 1950s.
As a sophomore and junior, Hirsch moved into the Wildcats regular rotation, and as a senior was the captain of UK's 1950–51 championship team.
While he made the SEC All-tournament team in 1951, he was declared ineligible for the 1951 NCAA tournament as he was a fourth year varsity player (prohibited at that time).
Hirsch, along with former UK teammates Bill Spivey and Jim Line, was accused of taking money to affect the outcome of several games during the 1950–51 season.
[7] Hirsch's involvement with gamblers led to a ban from minor league baseball for the promising first baseman prospect.