Lexington's construction of wood rather than brick or stone like Gunston Hall, may indicate the economic constraints imposed by the American Revolutionary War upon the patriot family.

Elizabeth Barnes Mason Graham died in May 1814, shortly before her husband's possibly most important military services assisting in the evacuation of Washington D.C. Their son George Mason Graham, born at Lexington, would like his half-brother fight in the Mexican–American War, as well as become rich operating his family's cotton plantation in Louisiana, before helping to found the educational institution which later became Louisiana State University.

[6] When that George Mason (who never had children) died of typhoid fever in Portland, Oregon in 1888, the property, which was becoming overgrown, was inherited by his sister Kora Chase, who sold it in 1903 to James D. Yeomans, a local real estate speculator as well as member of the Interstate Commerce Commission.

It then changed hands among various real estate investors and companies until 1967, when Wills & Van Metre, Inc. sold it to the Nature Conservancy, which was interested in the property because of two bald eagle nests discovered in 1965.

It was added to the National Register of Historic Places in 2013, in part because of its landscape design unearthed during those excavations, which resembles that of Gunston Hall, as well as Marlborough, a now defunct Stafford County plantation once the home of John Mercer, George Mason's relative, guardian during his minority and mentor, and who died in 1768.