[2][3] It had become an episcopal residence by the time of the Wars of Scottish Independence, when William Wallace recaptured the castle from the English in 1296.
Archbishop Beaton added a large corner tower, and surrounded the whole complex with an ashlar wall with crenellated and reinforced bastions.
The castle played a role in the many political battles during the 16th century, including the protracted struggle between supporters of Mary, Queen of Scots, and her enemies.
The castle fell into disrepair during the 17th century, despite an attempt at repair by Archbishop Ross in the 1680s,[3] and was gradually dismantled for its stone.
The museum building was designed by architect Ian Begg to reflect the style of the Bishop's Castle.