[3] On December 17, 1874, he married Ida Prince, and they had a son, Edward Danforth, and a daughter.

There, Danforth practiced law in partnership with George H. Winsor, and was President of the Corporation of Bainbridge.

In August 1893, it became known that Danforth had received a loan of $50,000 (about seven times the annual salary of the Treasurer) from the Madison Square Bank in New York City in exchange for keeping a large amount of State monies in that bank.

In 1898, he ran for Lieutenant Governor of New York with Augustus Van Wyck but they were narrowly defeated by Theodore Roosevelt and Timothy L. Woodruff.

He died on January 7, 1906, at his home at 51, East 58th Street in Manhattan, of pneumonia, and was buried at Woodlawn Cemetery in The Bronx.