At the last moment, however, Heyman changed his mind and agreed to play for the Tar Heels' greatest rivals, the Duke Blue Devils.

During the varsity game that night, Heyman was involved in two incidents, where he first pushed over a fan who he thought was attacking him, and then in the closing minutes of the game, while trying to protect a slim Duke lead, Heyman committed a hard foul against future Hall of Fame coach Larry Brown who was attempting to drive to the hoop.

Heyman and Duke avenged that 1961 loss, defeating the Demon Deacons 68–57, earning the Blue Devils the right to play in the 1963 NCAA Tournament.

The Blue Devils were given a bye to play in the round of 16, and they defeated New York University, who had Happy Hairston and Barry Kramer, 81–76 in the East regional semi-finals, with Heyman scoring 22 points, and adding 13 rebounds.

Despite Heyman's 29 points and 12 rebounds in the semi-finals, the Blue Devils succumbed 94–75 to eventual national champion Loyola of Chicago (who had All-American Jerry Harkness).

In the consolation game, Heyman completed his college career when Duke defeated Oregon State (who had Heisman Trophy winner Terry Baker) 85–63.

Heyman is one of three athletes in ACC History to have been elected unanimously to the All-ACC Men's Basketball team three times, along with David Thompson and Tyler Hansbrough.

[16] However, his mercurial temper and frequent outbursts saw his playing time with the Knicks decreased during his second year, and his scoring average dropped to 5.7 points per game.

Heyman parted ways with New York in 1965, and after brief stints with the Cincinnati Royals and Philadelphia 76ers, he left the NBA for the Hartford Capitols of the Eastern Professional Basketball League (EPBL) in 1966.

Heyman, Larry Brown and Charley Rosen, led the United States basketball team to a gold medal at the 1961 Maccabiah Games.