It is an historic ancestral seat of a junior branch of the Scottish House of Stewart, known by the territorial title Seigneur d'Aubigny.
The estate was a dependency[3] of the Seigneurie d'Aubigny-sur-Nère, which was granted in 1423[4] by King Charles VII of France to Sir John Stewart of Darnley, 1st Comte d'Évreux, 1st Seigneur de Concressault, 1st Seigneur d'Aubigny (c. 1380 – 1429) a Scottish nobleman and famous military commander who served as Constable of the Scottish Army in France, supporting the French against the English during the Hundred Years War.
The surviving structure, including the central corps de logis and chapel, was probably built between 1495-1500[4] by Bernard Stuart, 4th Seigneur d'Aubigny (d.1508) (Bérault, grandson of Sir John Stewart of Darnley), Captain of the Archers of the Scots Guards (an elite bodyguard of the French Kings) and Lieutenant-General of the Kingdom of Naples.
The Gallery Wing with the two pavilions and the main entrance were added in about 1520-25[4][3] by his first-cousin once removed and son-in-law and successor Robert Stuart (d.1543), 4th Seigneur d'Aubigny, who married his daughter and heiress Anne Stewart.
After Charles's death in 1685 Louise left England, with two shiploads[9] of magnificent paintings and furniture from her apartment in the Palace of Whitehall given to her by the king, and lived the rest of her life at la Verrerie.