It is believed to be on the site of a former "hospital" or "hospice" (i.e. a hostel) adjacent to the Chapel of St Paul.
The hospital was founded by William of Bec (or Beck): records go back before 1224 (in the reign of King Henry III).
The hospital was, at an early date in its history, well endowed with the manors of Beck, Billingford, and Howe, and with certain lands and rents in upwards of thirty Norfolk parishes.
The hospital appears to have become a residence and may have been leased by The Church authorities before the Dissolution of the Monasteries.
[6] With the dissolution in the mid-16th century the property was granted to Sir John Perrot.