After serving in the U.S. Army during World War II from 1944 to 1946 Jymie returned home to work for a short time in his father's real estate business, and after a brief flirtation with the clarinet he was inspired by a Duke Ellington recording featuring bassist Jimmy Blanton.

In the early 1950s he toured with rock and roll musicians Bull Moose Jackson and Chris Powell moving on to work with bluesman BB King from 1955 to 1957.

The Messenger ensemble Merritt joined featured his friend Benny Golson as well as Bobby Timmons and Lee Morgan.

Morgan's Blue Note album Live at the Lighthouse (1970) featuring Merritt's composition "Absolutions" (recorded earlier by Max Roach).

[1] Among the original members of the Forerunner band were Odean Pope, Kenny Lowe, Donald Bailey, and September Wrice.

Saxophonist Bobby Zankel was a member of the second incarnation of the band when he joined in 1982, which also included Alan Nelson, Odean Pope, Julian Pressley, Colmore Duncan, and Warren McLendon.

Merritt joined the Bull Moose Jackson band in 1949,[5] and was an early adopter of the Ampeg Baby bass (a hybrid acoustic-electric instrument).

"[4] In November 2013, along with friend and fellow bassist Reggie Workman, Jymie Merritt received the Clef Club of Philadelphia's Living Legend, Jazz Award.

[7] In addition, Jymie Merritt was honored with the Don Redman Heritage Award in June 2008 at a ceremony and concert in Harper's Ferry, West Virginia at the annual event sponsored by the Harpers Ferry Historical Association and the Jefferson County NAACP in cooperation with the Don Redman Heritage Society of Piedmont, West Virginia.

[10] With Art Blakey and the Jazz Messengers With Chet Baker With Sonny Clark With Curtis Fuller With Benny Golson With Lee Morgan With Max Roach