McGriff formed a combo that played around Philadelphia and often featured tenor saxophonist Charles Earland (who soon switched permanently to organ, and became one of the instrument's renowned performers).

During this time, McGriff also accompanied such artists as Don Gardner, Arthur Prysock, Candido and Carmen McRae, who came through town for local club dates.

McGriff recorded a series of popular albums for the Sue label between 1962 and 1965, ending with what still stands as one of his finest examples of blues-based jazz, Blues for Mister Jimmy.

Lester framed McGriff in many different groups, performing a wide variety of styles and giving the organist nearly unlimited opportunities to record.

McGriff was heard everywhere from an all-star tribute to Count Basie: The Big Band (1966), a series of "organ and blues band" albums such as Honey (1968) and A Thing to Come By (1969), funk classics like Electric Funk (1970), covering pop hits ("Cherry", "Blue Moon", "The Way You Look Tonight") and such original singles as "The Worm" and "Step One".

He settled in Newark, New Jersey, and eventually opened his own supper club, The Golden Slipper - where he recorded Black Pearl and another live album, Chicken Fried Soul with Junior Parker in 1971.

[1] By 1980, McGriff broke away from Sonny Lester and began working actively with producer Bob Porter (and recording engineer Rudy Van Gelder).

McGriff began a long relationship with Milestone Records collaborating with Rusty Bryant, Al Grey, Red Holloway, David "Fathead" Newman, Frank Wess and Eric Alexander.

On March 29, 2008, McGriff was given a last private concert by Bill "Mr. B3" Dilks and drummer Grant MacAvoy in his honor in Voorhees Township, New Jersey.