Its design has historically been attributed to John Hampton White, but no documentation exists to validate the claim.

What is documented is that Lewis Evans, a wealthy Natchez planter, purchased the land on which Arlington stands in 1806.

Thompson then sold the Arlington property, including the house built by Evans, to Mrs. Jane Surget White in December 1818.

Jane White was the daughter of Pierre Surget, a French emigrant at the head of one of Natchez's leading families.

[7] Arlington has been considered by architectural historians to be "one of four important Federal Style villas which established the basic form for the later antebellum houses of Natchez.

[4] The front doorways on both levels are trimmed with radiating brick voussoirs, with carved marble impost blocks and keystones.

A two-story barn is situated about 150 feet (46 m) west of the rear courtyard, separated by a geometric boxwood garden.

At this time a cast iron porch was added over a central doorway to the stair-hall on the east side of the house and the attached wing was reworked.