In the mid 17th century, Charlotte Gouffier became enamored with the renowned intellect, Blaise Pascal (1623–62), who spent considerable time at the Château d'Oiron.
After Pascal died, Charlotte Gouffier married Francois d'Aubusson, the duc de La Feuillade, who enhanced the castle with his wealth and connections to Louis XIV.
With the renovations, the castle ended up with a main building and two long projecting wings, one of which is a Renaissance structure built over a cloister.
For many years the château lay abandoned until the government of France took possession just before World War II eventually converting it to a museum.
In 1993, The Year of Solar Burns by conceptual artist Charles Ross was commissioned by the French Ministry of Culture for permanent installation in the Château d'Oiron.