On the album, Thornton is joined by members of the Jazz Composer's Orchestra, supplemented by seven musicians playing African percussion instruments.

"[5] John Corbett called Thornton "another figure whose thin discography distorts his real significance," and described the album as "gorgeous, majestic, intricate.

Thornton's compositions get superb treatment here from the Jazz Composer's Orchestra... Gardens of Harlem weaves together into one grand tapestry the many experimental directions being pursued on the New York scene during that period.

"[4] David Hollenberg, in a 1976 review for Mother Jones, commented: "The Jazz Composer's Orchestra... have published ten records... All are ambitious and honest, especially a recent album entitled The Gardens of Harlem...

"[7] In a review for AllMusic, Eugene Chadbourne wrote: "There was something of a struggle getting this project finished and released... Gardens of Harlem... perpetually in the oven or being rehearsed in dribs and drabs, was to be [Thornton's] masterpiece, bringing together Afro-Cuban, Jamaican, Ghanaian, Algerian, American blues, and gospel influences as well as a piece based on the cry of a South Carolina fruit vendor.