As a native of Lingchuan (灵川), Jiangxi, Rao was among the few senior leaders of early stage of CCP who received a higher education.

He became educated at Shanghai University in his early days and later joined the Chinese Youth, and turned into a CCP member in 1925.

When the 1920s revolution was oppressed by Kuomintang, Rao went abroad for study in England, France and the Soviet Union for approximately a year.

In 1939 Rao returned to China and worked in the New 4th Army, acting as Deputy General Secretary of Southeast Bureau of CCP.

In 1942, Rao replaced Liu who was called back to Yan'an as Acting general secretary and Commissar of New 4th Army.