[3] The current site of the castle is occupied by a car park for the nearby Walsall Manor Hospital and the moat ran along what is now southern Moat Street - despite this, no visible remains exist and all earthworks have been flattened.

It first appears in records in 1275,[3] when it was owned by William de Morteyn, who gave it to his son Roger when he died in 1283.

When Roger died, the castle was passed down to the Baron Bassets of Drayton until the barony went extinct in 1390.

Lady Neville stayed at Walsall Castle in 1385-86 with her two children while Ralph Basset owned the manor house.

[2] A Mr. Holmes purchased the site in 1763 and had two houses built on the site; the houses built by Holmes were abandoned by the 19th century and in 1885, the northern section of the moat was filled in but the rest of the moat still contained water until at least 1974.