As of the late 20th and early 21st century, the site was subject to a program of "long-term phased restoration", and is partially opened for tours.

The evidence is that he had a manor in Swords by 1192, as a patent was granted to him there on that date authorising him to hold an annual fair lasting a week on the feast day (9 June) of St. Columba.

In 1216 the manor of Swords was granted to Henry de Loundres, the second English Archbishop, and it is recorded that in 1220 one William Galrote held the position of chief constable of the castle.

The evidence for this is that in 1326 de Bicknor was accused of mishandling the treasury and the profits of his see were seized by the king and an inquisition was held before the Sheriff of Dublin on 14 March 1326.

In all likelihood Swords was abandoned because of damage sustained during the Bruce campaign in Ireland of 1317, which was known to have devastated the country south from Dundalk to the gates of Dublin.

Although there is no direct evidence that Swords Castle had been attacked by Bruce's forces, it was not well fortified enough to withstand assault, and the probability is that the Archbishop had removed himself to Tallaght for safety reasons.

As late as 1547 Thomas Fitzsimons of Swords was appointed constable, and subsequently the Barnewall family retained an interest in the constableship and tenancy of the castle.

The viceroy, Sir Henry Sydney, had some of the building repaired for the use of the colony of Dutch weavers who he hoped might 'show some example of industry to the lazy natives'.

After the Church of Ireland was disestablished in 1870 the castle was sold to the Cobbe family, who leased it to local shopkeeper Robert Savage.