The town was created a royal burgh by King William the Lion in 1186.
King Alexander III of Scotland visited the castle in 1264 to plan an expedition against the Isle of Man.
Robert de Brus, 5th Lord of Annandale captured the castle in 1286.
Robert de Brus captured the castle briefly in 1306 from the English-appointed constable Richard Siward.
King Robert I of Scotland captured the castle on 7 February 1313 from the English appointed constable, his enemy Dungal Macdouall, who had turned King Robert's brothers, Thomas and Alexander, over to Edward I, who promptly executed them.