Zhang was born into a family of farming background in Sidian Township [zh] of Xin County, Henan, in 1906, during the late Qing dynasty.

He joined the Chinese Communist Party in February 1931, and enlisted in the Red Army in April of that same year.

After graduation, he took part in the counter encirclement and suppression battle in Huhei-Henan-Anhui Soviet Area.

[citation needed] During the Chinese Civil War, he was promoted to director of the Political Department of the New Fourth Brigade in 1948 for his actions at the operation for safeguarding Yan'an led by Peng Dehuai in Shaanxi.

[citation needed] After the establishment of the Communist State in 1949, he was appointed party secretary of Dihua (now Ürümqi).