[1] Joe was born in Ngxaza, Tsolo, Eastern Cape in 1918.
His mother was Martha Mzizi and his father was Shadrach Mzamane who was an Anglican voluntary preacher.
[2] Joe did his primary school at St. Cuthberts Mission, Tsolo.
He obtained a Diploma in Theology from St Peters College Rosettenville and was the rector of St. Barnabas Church, KwaThema from 1962-1982.
[3] He was also the National and Regional President of the Interdenominational African Minister's Association (IDAMASA).