She could be considered an orphan since after her birth her father had remarried after her mother's death and moved to Kentucky.

[citation needed] Her mother's family, the Claylands were Episcopalians and had settled in America after leaving England in 1670.

A biographer described the Claylands as slaveholders, wealthy and active in political and social life during the American Revolution.

No unkind word ever passed between members of the family, for strife was repelled and anger was washed away by the stream of love."

[3] Eliza lived through changing economic that brought hardships upon the family when William faced the loss of property.

[4][5][1] Primary source material including family letters and other items are housed in the University of Pittsburgh Library System Archives Service Center.