[1] Reynolds was born in the Town of Greene in Chenango County, New York[2] on February 5, 1836; he was educated at Cortland Academy, and at Harvard University,[2] taking the classical and legal courses.
Contrary to the information in his obituary,[2] Joseph first moved west to Minnesota, where he practiced Law and lived with his uncle, Lyman Reynolds and his late aunt Catherine's widower, Augustus L. Ballard.
Sometime after the June 21, 1860 US Census for Lakeland, Washington County, Minnesota, he moved to Chilton, Wisconsin going into partnership with local attorney Harrison Carroll Hobart.
When the American Civil War began, a company was formed in Chilton by Hobart, and Reynolds was one of the first to enlist.
He remained in Chilton a few years and then moved to Boone, Iowa, where he took charge of an extensive farm owned by him.