Ludwell graduated from the College of William & Mary and married Frances Grymes (d. 1753) of Morattico plantation on the Northern Neck of Virginia shortly before he officially became an adult and gained control of his inheritance.

[4] Ludwell also held various offices in James City County and Jamestown, including leading the local militia (hence the "Colonel" title).

He was also given exceptional permission to continue to attend Anglican services in Virginia, since the dispensation recognized that "apart from the Province of Pennsylvania, all religions but Protestantism are banned.

"[2] Although in declining health at the end of his life, Ludwell translated The Orthodox Confession of Peter Mogila, Metropolitan of Kiev, from Latin, and published this book in London in 1762.

However, the house he built was destroyed in the American Civil War, and the College of William and Mary never established a school, but instead litigated with Lee's executors.

Her sister Lucy Ludwell Paradise inherited Rich Neck Plantation and upon returning to Virginia as a widow, also lived in the Ludlows' Williamsburg town house c. 1805–1812.