Built in 1809, it was from 1809 to 1819 the home of Emma Willard (1787–1870), an influential pioneer in the development of women's education in the United States.

The main block is a 2+1⁄2-story brick structure, four bays wide, with a hip roof and a stone foundation.

Emma Hart Willard was born in 1787 and educated at home, developing an interest in teaching at an early age.

In 1814 she opened her Middlebury Female Seminary out of the family home to bring in additional income, and operated it there until 1819.

In addition to managing the school, she taught classes and wrote textbooks, including volumes on geography and history that saw wide use.