Born 10 July 1901 in Rochester, New York, Rauber graduated from high school there in 1918, then saw two years active duty in the National Guard.

Upon the outbreak of World War II, Rauber again offered his services to the Marine Corps, and on 1 May 1942, reenlisted and was re-appointed to the rank of sergeant.

In March 1950, Rauber embarked for the United States for a brief assignment as Sergeant Major, Inspector-Instructor Staff, 19th Infantry Battalion, Rochester, New York.

Ordered to Cherry Point, North Carolina in January 1951, he served consecutively as Squadron and Group Sergeant Major with MCGIS-5 and MACG-1, 2nd Marine Aircraft Wing.

Transferred to Washington, D.C. in April 1954, Rauber began a four-year tour of duty as Sergeant Major of the Personnel Department, Headquarters Marine Corps.