Brown signed to play for the University of Dayton in 1960, but he was banned from the National Collegiate Athletic Association (NCAA) and National Basketball Association (NBA) when it was revealed that while still in high school and along with fellow Brooklyn star Connie Hawkins, he had been introduced to a gambler, Jack Molinas, who was involved in illegal point shaving.

[1] Over his eight-year (1967–1975) ABA career, spent with the Pacers, Memphis Sounds, and Utah Stars, Brown scored 10,498 points, appeared in four All-Star games.

On March 11, 1969, Brown set a Pacers franchise record with 46 points scored in a single game, during a win over the New York Nets.

[2] That postseason, during the 1969 ABA Finals, Brown averaged 25.6 points, 6.6 rebounds, and 2.6 assists a game, in a five-game series loss to Warren Jabali and the Oakland Oaks.

[3] The following postseason, during the 1970 ABA Playoffs, Brown was named Playoffs MVP after he averaged a postseason career best 28.5 points a game en route to a finals victory over the Los Angeles Stars, in which Brown scored 45 points and grabbed 11 rebounds in a decisive Game 6 victory.