Baldwin received his first award for his actions during the Atlanta Campaign where he led his company in battle at Peachtree Creek and captured two commissioned officers in the American Civil War.

Baldwin served in the Civil War in the 19th Michigan Infantry, initially as a first lieutenant,[2] fighting in all his regiment's battles from 1862 to 1865.

In 1864, then-Captain Baldwin participated in General William Tecumseh Sherman's famous March to the Sea, and on July 20 of that year distinguished himself at the Battle of Peachtree Creek, earning his first Medal of Honor.

On November 8, 1874, while commanding a scout company on escort duty, he led a surprise attack on the camp of Grey Beard, rescuing two young sisters whose parents and brothers had been killed by another Indian band.

[3] General Baldwin was a companion of the Michigan Commandery of the Military Order of the Loyal Legion of the United States.

[5] Citation: "Led his company in a countercharge at Peach Tree Creek, Ga., 20 July 1864, under a galling fire ahead of his own men, and singly entered the enemy's line, capturing and bringing back 2 commissioned officers, fully armed, besides a guidon of a Georgia regiment."

[6] Inducted into the Hillsdale County, Michigan Veteran's Hall of Fame in 2004 for his distinguished service in the American Civil War.