His mother was the granddaughter of Colonel Ralph Pope, aide-de-camp to Gen. George Washington.

[7] His grandfather John Atherton had been a founding member and had hosted many musical events for the Society at his home.

He greatly improved the financial standing of the family, establishing himself as a retail dealer in boots and shoes, after entering into partnership with Stetson.

[9] By 1852 "Atherton, Stetson and Company", dealers in leather, were one of Boston's most successful business at the time.

Temperance died of consumption at the age of 29 when her youngest daughter, Sarah was just five months old.