Ruffner was born 12 January 1903, in Buffalo, New York, and graduated from the Virginia Military Institute in 1924.

Most of his early career was spent in various cavalry units until his appointment as Assistant Professor of Military Science and Tactics at Norwich University in Vermont from 1937 to 1940.

Ruffner's unit occupied the center of the UN line during the Battle of the Soyang River during the Chinese spring offensive.

After his command, Ruffner spent the remainder of the war in Washington working on International Security Affairs in the office of the Defense Secretary.

Ruffner concluded his career as United States Representative to NATO, and retired in 1962.