[2] Guéthénoc [fr] (or Guithenoc), vicomte of Porhoët, Rohan and Guéméné, began to build the first castle on the site around the year 1008, choosing a rocky promontory overlooking the valley of the Oust.
Since the 9th century, there had also existed an annual pilgrimage in September to the Basilica of Our Lady of the Bramble [fr] (Notre-Dame du Roncier), which added greatly to the wealth of the lords and people of Josselin.
[7][8][9][10] In 1370 the Breton soldier Olivier V de Clisson (1336–1407), later Constable of France, acquired the lordship of Josselin and built an imposing new fortress with eight towers and a keep one hundred yards across.
His daughter, Anne of Brittany, restored it to Jean II of Rohan, a great-grandson of Olivier V de Clisson, who transformed the property and built an imposing new house with a fine granite facade, an early example of Renaissance architecture, bringing in Italian artists and artisans.
In recognition of his patroness Anne, who was both sovereign Duchess of Brittany and Queen Consort of France, at several points along the facade Rohan added her badge, the letter A beneath a cord sculpted in stone.
In 1629, Cardinal Richelieu dismantled the keep and four of the towers at Josselin and announced to Duke Henry: "My lord, into your game of skittles I have just thrown a good ball!