His son, Robert Hall Baker, became a prominent businessman and Republican politician in Racine, Wisconsin.

The son of James and Elizabeth Price Baker, he was born in New York City but quickly moved with his family to Addison County, Vermont.

[2] During the American Civil War, he served as a Judge Advocate under Provost Marshal I. N. Bean, in the Wisconsin 1st district.

[1] Baker married his first wife, Martha Washington Larrabee, September 6, 1830, while he was living in Troy, New York.

His son Robert Hall Baker was also a prominent 19th century politician and businessman in southeastern Wisconsin.