Born in Knoxville, Tennessee, Suffridge's father encouraged him to box as a child.
James then followed his father in becoming a grocer, moving to Oakland, California, where he joined the Retail Clerks International Union (RCIU).
He also became known for making compromises with large grocery chains, in exchange for them permitting their workers to unionize.
[1][2] In 1944, Suffridge was elected as president of the RCIU, moving to the top position of secretary-treasurer in 1947.
In 1953, the union decided to make the presidency its senior position, and Suffridge moved back into it.