[4] By 1845, Jeffrey and her mother and her sister, Phoebe Whitehurst, had moved to Boston where their half-brother, Manuel Smith, was born in February 1845.

Her husband's father, the Reverend Roswell Jeffrey, was a real estate investor and political activist in Rochester.

[3] Hester and Jerome Jeffrey lived in Troy, New York, from 1868 to 1872, where he worked as machinist and waiter, according to the 1870 U.S. Census and city directories.

[1] The Hester C. Jeffrey Club helped raise money for young black women to take classes at what later became the Rochester Institute of Technology.

[11] Jeffrey also created the first memorial for Anthony, which was a stained-glass window installed at the AME Zion church in Rochester and unveiled in 1907.

By 1915, Jeffrey had moved back to Boston, where she lived with her niece, Georgine (née Glover) Brown, at 418 Newbury St.[4] The women taught music.

Hester died on January 2, 1934, in Boston and is buried in an unmarked grave in Woodlawn Cemetery in Everett next to her sister, Phoebe Whitehurst Glover.