While the origin of the name, "Eagle's Nest", is unknown, one possible explanation has to do with the fact that a Mr. FitzHugh of Virginia married one of famed lawyer Daniel Dulany's sisters and lived with her at "Fitzhugh Farm", adjoining the original "Eagle's Nest" to the north.

The FitzHughs owned, among other properties, a plantation north of the James River named, "Eagle's Nest".

Thomas's son, Joshua, served as a captain in the Revolution and afterward became financially successful in his management of raising and selling crops and livestock.

The newest portion, the garage wing, incorporates timbers salvaged from the old slave quarters before the flooding of the valley in order to create Loch Raven Reservoir.

[2] Foundation ruins of the barn, tenant farmer's house, and tollbooth still stand, though now on neighboring properties.