Brown graduated from New York University with a degree in music.
[2] With George Wein, he went to Europe to look for musicians for the International Youth Band.
[2] In the late 1950s he started the Newport Youth Band.
[2] His students included Eddie Gomez, Duško Gojković, George Gruntz, Albert Mangelsdorff, Jimmy Owens, and Gabor Szabo.
[2] He worked with Ruby Braff, Bobby Hackett, Lee Konitz, and Pee Wee Russell.