The Gatehouse originally formed part of Westbury College, a residence for the dean and canons of Holy Trinity Church.

The college building was fortified with towers, turrets and battlements surrounding a quadrangle, onto which the gatehouse opened.

The college itself had been founded earlier, but these buildings were erected between 1459 and 1469 by John Carpenter, Bishop of Worcester and Westbury.

Now, the only other surviving parts of the original college are two round towers and the retaining wall alongside the River Trym.

Westbury College Gatehouse is let to tenants and is not currently open to the public as a visitor property, therefore, it does not feature on the National Trust web pages.