In 1947, after working with Lucky Millinder, Tab Smith, J. C. Heard, and Coleman Hawkins, he replaced Ray Brown in Dizzy Gillespie's band, in which he played until 1950.

In the 1950s he recorded with the Miles Davis nonet, Earl Hines, Count Basie, Johnny Hodges, Thelonious Monk, Mongo Santamaria, George Shearing, Cal Tjader, Herbie Nichols and Hawkins.

McKibbon was credited with interesting Tjader in Latin music while he played in Shearing's group.

In 1999, the first album in his own name, Tumbao Para Los Congueros De Mi Vida, was released.

With Nat Adderley With Lorez Alexandria With The Byrds With Nat King Cole With Sonny Criss With Miles Davis With Victor Feldman With Dizzy Gillespie With Coleman Hawkins With Johnny Hodges With The Jazz Crusaders With Charles Kynard and Buddy Collette With Thelonious Monk With Randy Newman With The Night Blooming Jazzmen With Herbie Nichols With Shuggie Otis With Van Dyke Parks With Freddie Redd With Martha Reeves With George Shearing With George Shearing and Dakota Staton With Frank Sinatra With Robert Stewart With Billy Taylor With Cal Tjader With Jack Wilson