The Hall was home to Thomas and Margaret Fell, the latter an important player in the founding of the Religious Society of Friends (Quaker) movement in the 17th century.

She arranged for him to preach in St Mary's Church in nearby Ulverston and at the Hall.

During his time there, many people were convinced of the truth of his teachings.When Thomas Fell returned home, he was persuaded by his wife and some others to listen to Fox, who successfully appealed to his pro-Parliamentary sentiments.

Fell was never totally convinced by Fox's religious teachings, but he did allow his home to be used as a meeting house for the early Friends.

Eleven years later George Fox married the widowed Margaret Fell, and when not travelling, occasionally lived at Swarthmoor.