Born in Achern, in the German state of Baden, Weber graduated from the military school at Karlsruhe in 1843, and served as an infantry lieutenant in the Grand Duke's army.

[1] He raised a German-American unit known as the "Turner Rifles," a company that eventually became a part of the 20th New York Infantry.

From September 1861 until May 1862, he commanded Camp Hamilton, near Fort Monroe, being commissioned brigadier general of volunteers on April 28, 1862.

He was at Newport News during the fight between the Monitor and Virginia in anticipation of a Confederate attack by land.

The injury forced Weber off to a series of desk assignments for the duration of the conflict.