Brooks's first professional gig was with the medicine show of Pepper McAllister.
He served in the Army during World War II, there he played with James Moody.
He moved to New York City after his discharge in 1944, where he played at Minton's Playhouse and the Harlem Grill.
After a short run with Jimmy McGriff in 1974, Brooks became a member of Bill Doggett's ensemble, where he remained for two decades (1976–1996).
Brooks worked in the middle of the 1990s with Bross Townsend, Carrie Smith, and the Harlem Blues and Jazz Band.