She was born in Richmond, Surrey, and spent her early years at Moor Park, Farnham, home of Sir William Temple, 1st Baronet.

Stella's father is said to have been a merchant who died young: gossip that she was Temple's illegitimate daughter seems to rest on nothing more solid than the friendly interest he showed in her (there were similar rumours about his supposed relationship with Swift).

[3] Esther became extremely popular in Dublin and an intellectual circle grew up around her, although it was said that she found the company of other women tedious and only enjoyed the conversation of men.

This led to a violent quarrel between them, and Vanessa before her death in June 1723 destroyed the will she had made in Swift's favour, leaving her property to two men, George Berkeley and Robert Marshall, who though eminent in their respective callings were almost strangers to her.

The marriage ceremony was allegedly performed in 1716 by St George Ashe, Bishop of Clogher (an old friend of Swift, and also his college tutor), with no witnesses present, and it was said that the parties agreed to keep it secret and live apart.

On the other hand, Thomas Sheridan, one of Swift's oldest friends, believed that the story of the marriage was true: he reportedly gave Stella herself as his source.

Historians have been unable to reach a definite conclusion on the truth of the matter: Bishop Ashe died before the story first became public, and there were no other witnesses to the supposed marriage.