In 1847, Rauch, following the tradition of his family and his older brother, entered the Prussian Army, becoming a Second-Lieutenant in the 1st Foot Guards.

By personal request of Prince Friedrich Karl, Rauch became the adjutant of 1st Guards Infantry Division in August 1857.

During the Franco-Prussian War he was commander of the 1st Guards Landwehr Regiment's third battalion, leading it in the sieges of Strasbourg and Paris.

After the war Rauch became commander of the Lehr Infantry Battalion and from 1873 onwards led the 109th (1st Baden) Life Grenadier Regiment.

In 1897, the year of his 50th service anniversary, Rauch received the substantial promotion to that rank and was awarded the Grand Cross of the Order of the Red Eagle with Oak Leaves, Swords and Crown with his retirement.

Their sons Friedrich Wilhelm von Rauch, First Lieutenant à la suite of the 1st Foot Guard Regiment and Military Governor of Emperor William II's sons, and Leopold von Rauch, Colonel in the German General Staff, took up military careers as well.