[4] Edwards and I'Anson state that the castle was built by King William in 1068, who was known to have encamped at Northallerton whilst conducting the Harrying of the North.

[8][9] Pudsey is also referred to as having "greatly enlarged" the castle at Northallerton around 1174 (the time mentioned above when he was also attributed with its initial building) as a way of providing security for his estates in Allertonshire.

The great tower and a palisade wall are thought to have been made from wood, but the rest of the castle is undetermined in its structure.

[13] In 1177, Bishop Hugh Pudsey was required to appear before Henry II and account for his actions, having been suspected of allowing Scottish troops free access across his lands in years previous.

[14][15] Only the north-eastern arc of the castle edge remains - the rest of the site was destroyed when the railway was built through the location in 1838.