The house was designed by Thomas Jefferson, president of the United States and Barbour's friend and political ally.

Until it burned on Christmas Day 1884, Barbour's house stood essentially as completed, c. 1822, from designs by Thomas Jefferson.

Although the dining room had no chamber over it, Jefferson indicated a faux window on the second floor level in order to keep the garden front symmetrical.

[3] Barbour's estate has been known for its unusually large and fine boxwood, which flourish on the grounds immediately surrounding the main house.

Thomas Jefferson's role as architect and the fineness of the design, still visible as a ruin, were the prime factors in the property's listing.