In 1949, he graduated, was commissioned an officer, and assigned to serve on the submarine M-113 of the Black Sea Fleet.

In 1951, Zhiltsov attended Advanced Naval Submarine Navigation courses in Leningrad, which he completed with distinction in 1952.

In 1962, he twice took his submarine to the North Pole and on 20 July 1962 Zhiltsov was awarded the title of Hero of the Soviet Union for this exploit.

In 1966, he graduated from the Naval Academy in Leningrad, after which he became commander of the Baltic Fleet submarine division and held various other command positions in the Baltic and Northern Fleets.

While retired, he served on the Navy Acceptance Commission for new ships before he died in 1996.