Joseph was born in St. James Parish, Louisiana in 1877 during Reconstruction, and moved to New Orleans by 1906.
He later played in the Claiborne Williams band and the Original Tuxedo Orchestra.
For years in midlife he worked professionally as a barber, playing music occasionally on the side.
He was a regular at Preservation Hall until he famously dropped dead there in 1965 after finishing a rousing version of "When the Saints Go Marching In".
He was 87 years old and his jazz funeral took place at St. Augustine Catholic Church in New Orleans.