Martin played guitar in his youth before settling on tuba as his main instrument.
In 1923, he traveled to Chicago and played with the New Orleans Rhythm Kings with whom he made his first records.
He also recorded guitar duets with Leon Roppolo, but these unfortunately were never issued.
In the 1930s, Martin worked as a staff musician at WSMB radio.
He played with dozens of noted New Orleans jazz musicians, appearing on record with Sharkey Bonano, Santo Pecora, Pete Fountain, Al Hirt, and others, and released one album under his own name on Southland Records in 1963.