[1][2] Wolvesey Castle, the medieval bishop's palace, was constructed in the 12th century under William Giffard and Henry of Blois.

[1][2][3] Only ruins survive of the 12th-century buildings, including the substructure of the current chapel, which was built in the 15th century as part of Wolvesey Castle.

The south and east wings were demolished by Robert Taylor under Brownlow North in 1786 because Farnham Castle remained the bishops' preferred residence.

Taylor retained a small part of the south wing, reusing some of the demolished portions to add a new east wall.

After Farnham was added to the new Diocese of Guildford and Portsmouth in 1927, W. D. Caröe refurbished the interior such that the bishop could use the palace as their residence again.

[3] There is an extensive portrait collection in the palace, including portraits of bishops from William of Wykeham to Michael Scott-Joynt, by artists including Andrew Festing, William Dring, George Henry, Arthur Stockdale Cope, Eden Upton Eddis, Martin Archer Shee, John Jackson, Henry Howard, Michael Dahl, Peter Lely, and Jan Rave.

The east window now has stained glass from 1933 designed by Christopher Webb, depicting people connected to the palace and including a memorial to Theodore Woods.