Built in 1898–99, it is a distinctive local example of a Dutch Colonial Revival summer country house.

[1] The Amory House is located on the grounds of the former Amory country estate, a large tract of land rising on the northern slope of Mount Monadnock between Old Troy Road to the west and the mountain's Pumpelly Ridge to the east.

The house is a rambling 2+1⁄2-story wood-frame structure, with multiple gambrel roof gables and a clapboarded exterior.

A screened porch with round columns provides a fine view to the west.

Notable occupants of the house include United States Senator Albert J. Beveridge and historian Henry Adams.