In August 2000, after being hired as executive director of the Jazz Foundation, Wendy Oxenhorn discovered the organization had only US$7,000 left in the fund.
Oxenhorn conceived of the idea for the concerts during her first year as executive director of the JFA in 2000, after watching a 1994 documentary called A Great Day in Harlem about jazz musicians.
Because of the success of the A Great Night in Harlem, they initiated the Jazz in the Schools Program, which generated employment for more than 400 elderly musicians in New York City.
Lilien and his partners at E-Trade started the Musicians Emergency Housing Fund, which enabled the Jazz Foundation to pay rents and keep mortgages from foreclosure.
On Monday, September 24, 2001, the JFA presented the first A Great Night in Harlem at the Apollo Theater on 125th Street and Adam Clayton Powell Boulevard, at 7 p.m.
The concert featured performances by Irene Reid with Don Milletello, Randy Johnston, Billy Phipps and Tootsie Bean.
A surprise award was presented to Bill Cosby by Leo Corbie, Chairman of the Jazz Foundation of America, and Quincy Jones.
Jones introduced the tribute to Ray Charles, arranged by Al Jackson; Kenny Barron and Regina Carter played "Georgia on My Mind".
A tribute to African drummer Babatunde Olatunji was performed by Sanga of The Valley, Shawn Banks, Gary Fritz, Gabu, Daoud, Seku, Tonge, John Ward, Checharp, Aba Shaini, and Bas.
[7] The 2006 benefit concert was hosted by Bill Cosby, Danny Glover, and Billy Taylor and featured performances by Seth Farber, Harold Mabern, the New Birth Brass Band, Odetta, and James Blood Ulmer.
[8] The sixth A Great Night in Harlem fundraiser concert was held on May 17, 2007, at the Apollo Theater, hosted by Bill Cosby, Danny Glover, and Gil Noble.
Dick Parsons and Chevy Chase presented the Medicine for Music Award to Jay Nadel and Frank Forte of Englewood Hospital & Medical Center.