Built in 1792, it is well-preserved example of period domestic architecture, and is further notable for a procession of owners important in the community's history.

It is a 2+1⁄2-story wood-frame structure, five bays wide, with a large central chimney, a side-gable roof, and a stone foundation.

Its main entrance is centered on the front facade, and is sheltered by a Federal-style portico supported by slender columns, with a decorated soffit.

It is also noted for a succession of residents who played significant roles in the growth of Bethel during the 19th century, including two ministers and three businessmen, the latter including Oliver Shepard, a figure instrumental in the separation of Bethel as a separate town in 1855.

Reverend John Ely, for whom the house was built, was Bethel parish's second settled minister, at a time when it was still part of Danbury.