Boxwood Hall was built about 1750, and is a National Historic Landmark for its association with Founding Father Elias Boudinot (1740-1821), who lived here from 1772 to 1795.

In 1772, Alexander Hamilton, another Founding Father, stayed briefly with the Boudinots while attending Elizabethtown Academy.

In 1795, Boudinot sold the mansion to Jonathan Dayton, also a Founding Father and then speaker of the U.S. House of Representatives.

After Woodruff's death in 1768, it passed to his son, but was eventually sold at public auction to Elias Boudinot in 1772.

The Boudinots remained in the house until the outbreak of the Revolution, when for safety reasons Hannah moved to a family property in Basking Ridge, NJ, and Elias assumed his duties as Commissary General for the Continental armies.