Mikhail Kovalev was born to family of a peasants in stanitsa Bryukhovetskaya, Kuban Oblast.

After graduating from a School for Praporshchiks Kovalev fought in World War I commanding a platoon (polurota), company and then a battalion.

During the Russian Civil War he commanded a regiment and then a brigade in the Red Army participating in the fights against White Armies of Denikin, Wrangel and the peasant Tambov Rebellion of Alexander Antonov.

He was the commander of the Belarusian Front during the Soviet invasion of Poland in September 1939.

In July 1945 he became a vice-commander of the Transbaikal Front and participated in military actions against Japan.