It dates from the early 17th century and has been described as "the most interesting building" in the village.

The Victoria County History for Lancashire records that, in the 13th century, the manor of Wiswell was held by William de Arches from the lords of Clitheroe.

[1] Clare Hartwell, in her Lancashire: North volume in the Buildings of England series, revised and reissued in 2009, describes Vicarage House as "the most interesting building" in the village.

[2] Historic England's listing record notes that the building material is sandstone rubble under a slate roof.

[4] The house remains a private residence and is not accessible to the public.