The two story structure with a large cellar is built of local rag-stone and was, at that time, in a preeminent location on the docks in Hythe, on the corner of the 12th century road to Canterbury called Clyme Hill, via Saltwood Castle.
Built of Kentish rag-stone and wide-joined rubble, the simple two story structure had an exterior staircase made of wood on the east side.
In 1335 the west wing extension was added along the quayside on Duck Lane, by Hamo de Hethe, by then Bishop of Rochester.
The west wing is built of roughly squared sandstone rubble with simple Gothic arched windows and a central door which leads, still today, through a stone floored passage that exits in the back garden.
Upon entering the cellar there is an ancient Ambry built into the stone wall, which would have been used for storage objects of a religious nature, holy waters, and the like.