The main farmstead is located on the southwest side of Kipling Road, consisting of a c. 1850 house along with a cluster of agricultural outbuildings, now mostly concerned with the production and processing of apples.

Remote buildings on the property include another farmhouse (c. 1845) on the west side of Dutton Farm Road, and two early 20th-century cottages.

[2] Portions of the land that makes up Scott Farm were probably cleared in the early 19th century, and used at subsistence levels.

In 1845 Rufus Scott purchased the land that now makes up the core of the farm, building the Greek Revival farmhouse about 1850, and the Cow Barn in 1862.

In 1995 Holbrook's heirs gave the farm to the Landmark Trust USA, a preservation organization that also owns nearby Naulakha, Rudyard Kipling's home.