It had been the site of a plantation complex, and prior to the American Civil War it was known for cotton production worked by enslaved people.

By 1860, Stone owned 83 enslaved people, and 5,000 acres (2,000 ha) in Montgomery County, with an additional 2,000 acres (810 ha) in Autauga County.

[2][3] Barton Warren Stone died in 1884, he was survived two wives and all but one of his sons.

[7] The two-story brick masonry house, fronted by a monumental Doric hexastyle portico, was built circa 1852, for Barton Warren Stone.

[2] The grounds of the property included a fruit orchard, and mature camellias and azaleas.