It occupies ground overlooking the confluence of the Tweed and Teviot waters, the site of what was once the Royal Burgh of Roxburgh and the intended southern centre for the developing Scottish kingdom at that time.

In the 14th century, Roxburgh became a focus for periodic attack and occupation by English forces and Kelso's monastic community survived a number of fluctuations in control over the area, restoring the abbey infrastructure after episodes of destruction and ultimately retaining Scottish identity.

The massive design and solid romanesque style of the tower indicate a very large building of formidable, semi-military construction and appearance, evidence of the importance with which Roxburgh was regarded when the abbacy was at the height of its power.

Construction of the abbey is believed to have commenced immediately, and by 1143 progress was sufficiently advanced for the building to be dedicated to the Blessed Virgin Mary and Saint John.

[3] Kelso Abbey, which was situated in sight of Roxburgh Castle across the Tweed water, soon grew to be one of the wealthiest and grandest in Scotland, with much of its income coming from its vast estates in the Border country.

[4] After Scotland's royal dynasty began to lose the overlordship of Northumbria, during the reign of William I, David's southern "capital" came into close proximity to the border with England and was subject to attack during the Wars of Scottish Independence.

First, in the 1540s, the building sustained major damage in attacks perpetrated under the orders of the English king, Henry VIII, part of the so-called Rough Wooing, in which most of southern Scotland's abbeys, including those at Melrose, Dryburgh and Jedburgh, were targeted for destruction by forces under the command of the Earl of Hertford.

A small remaining contingent of monks may have continued at the site for a number of years following the 1560 dissolution, but after further attacks and damage the abbey was declared officially derelict in 1587.

In 1805, huge parts of the ruins were cleared away, including the parish church and the gaol, leaving only the abbey's west tower and transept remaining to this day.

Little of the ground plan of this once large abbey exists, but the surviving ruin of the west tower, together with its crossing, is impressive and shows a building that was strong and fortress like.