One 19th century commentator described the approach to the house thus:[1] In passing up the Concord and Claremont Railroad from Concord, the observant traveler has doubtless noticed the substantial and comfortable-looking homestead with large and trim front yard, shaded by thickly planted and generous topped maples, on the right-hand side of the road after crossing the bridge that spans "Contoocook's bright and brimming river" at the pleasant-looking village of Contoocookville in the northern part of Hopkinton.In 1825, Roger Eliot Perkins came from the vicinity of Salem, Massachusetts and built Perkins Manor on land purchased from the Algonquians.

[1] His property passed to his son, Hamilton Eliot Perkins, a counselor-at-law and member of the Merrimack County bar.

Here Hamilton Eliot Perkins invested his means in shipping, including trade with West Africa.

One parlor was lavishly decorated in red velvet with beautiful antique furniture.

[3] Isabel Anderson occasionally stayed in the house, but preferred her own small, rustic summer camp in a rural area of southern New Hampshire that she used as a writing retreat and for visits with her relatives.