Among his many distinguished relatives included Nathan Hale, the patriot schoolmaster, and uncle Horatio Potter, the Episcopal Bishop of the New York.
Potter later he studied law and was admitted to the New York Bar, but gave up the practice of law to become Secretary and Treasurer of the Novelty Iron Works, then the most notable iron works in the U.S. After his 1849 marriage, he spent six months or more as an attaché at the Court of Berlin, Prussia.
[2] Potter was a prominent member of charitable organizations throughout his career, serving as a trustee of the Children's Aid Society from 1857 to 1897; president of the Orthopedic Dispensary from 1878 to 1891; president of the Association for Improving the Condition of the Poor from 1878 to 1884; president of the Niagara Park Association; treasurer of the United States Sanitary Commission; one of the managers of St. Luke's Hospital from 1869 to 1886; treasurer of St. Johnland from 1871 to 1883; first vice-president of the State Charities Aid from 1874 to 1880; trustee of his alma mater Union College, among other charitable and educational institutions.
Together, they were the parents of nine children, seven of whom lived to adulthood, including: Potter died in London, England on March 24, 1897.
[3] In his will, he left all of his property to his wife and specifically cut off his daughter-in-law Cora,[23] and all children born to her since January 1, 1880.