The name appears on various early documents in England, such as a charter of Æthelred II in 1005 where a witness signs as "Ego Ƿiþer minister" (I Wither, the assistant).
It seems to be a personal name, rather than a place name or occupational name, of unknown meaning: suggestions have included "wood", "withstand", "warrior" or "willow".
While the name occurs in connection with landholdings in various counties of England before the 1150s, the first continuous record of a family seems to be in Lancashire and Cheshire where Sir Robert Wither, knight, of Pendleton and of Halton, was seneschal to Roger de Lacy, who died in 1211.
By the 15th century, families claiming descent from Sir Robert Wither were living in Cheshire, Lancashire, Wiltshire, Essex, London, Somerset and Hampshire.
From 1484, they were lords of the manor of Manydown near Wootton St Lawrence, remaining linked to that estate for more than 400 years.