[1] Ravensworth was located near Annandale, Virginia, south of Braddock Road, west of the Capital Beltway (Interstate 495).

William Fitzhugh also had a townhouse in Alexandria at 607 Oronoco Street in 1799, which his family – in 1818 – lent to their cousin, Anne Hill Carter Lee, widow of Henry "Light Horse Harry" Lee, and her eleven-year-old son, Robert Edward.

[2] Eleven years later, on 26 July 1829, Anne Hill Carter Lee died at Ravensworth.

William Fitzhugh and Ann Bolling Randolph's daughter Mary Lee Fitzhugh married George Washington Parke Custis (Martha Washington's grandson) and became the mistress of Arlington House.

When Mary Anna Custis Lee fled Arlington House in May 1861 after the outbreak of the Civil War, she stayed at Ravensworth briefly, but then moved further south for fear of inviting damage to the home.