To the north the land is generally level and open, with single-family homes on the streets giving way to baseball diamonds in the park.

The building itself is a one-and-a-half-story wood frame structure on a brick foundation sided in clapboard with beaded corner boards in two sections.

The east (front) entrance is located in a gabled portico with its roof supported by two square fluted columns with similar capitals.

Connecting it and the main block on the north side is a small porch with square fluted columns similar to those on the front.

Lyman Brewster, who married into the family, met in the house with Woodrow Wilson while drafting the Negotiable Instruments Act.

The Iveses also developed side streets off Main, one of which is now named for the family, as the settlement grew into a city by the end of the century.

In 1924 the front dormers were added, the year the Iveses moved the house to Chapel Place, just behind the first site, so the Danbury National Bank could expand.

Charles and his brother also felt that, in a neighborhood that was by then heavily commercial, it had lost the aura that had helped inspire his music.

[2] Ives still visited the house frequently over the rest of his life, even after he gave up composing and moved to nearby West Redding, where he died in 1954.

It is the only extant former residence of his that is connected to his musical career, since the two houses where he lived in Hartsdale, New York, during most of his productive years are no longer in existence.

The bank conveyed the house to the Danbury Historical Society, which bought a 14-acre (5.7 ha) site south of Rogers Park and moved it to Memorial Drive.