On March 4, 1941, he married Christine Fentress, and they had one child, Joe Jr., who himself became a national Golden Gloves champion.

Several news stories quote Ali crediting Martin with having shown him how to "fly like a butterfly, sting like a bee."

In the 1950s and 1960s, Martin helped produce a weekly television show on WAVE-TV called Tomorrow's Champions, which was broadcast for twelve years.

After winning the gold medal, Ali began his professional career but maintained contact with Martin until his death.

[3] After retirement, Martin started a business as an auctioneer and twice ran unsuccessfully for Sheriff of Jefferson County, Kentucky.