The house is decorated throughout with detailed woodwork and glass that show the wealth of the original occupants.

In 1884 scandal hit the family when one of Amos' sons, John Chester, embezzled millions of dollars from his father's bank and then fled to Canada to avoid prosecution.

He built additions onto it in order to accommodate visits from his large family, including numerous bedrooms and a new wing.

[1] Amos' daughter Antoinette Eno Wood who aided her disgraced brother lived in the house caring for her father.

After his death she refused to leave the home and paid her brother, Amos a life tenancy to remain there.

She also carried out a series of renovations on it, including landscaping by the Frederick Olmsted firm, who designed Central Park in New York.

[2] Upon her death, the house was passed through her brother Amos Frederick's will to his minor nephew, who eventually sold it.