The oldest part of the main building was built in 1751 for countess Anna Sophie Schack but it was later expanded by an extra storey in 1847 and adapted in 1873 and again in 1904.
It belonged to the Crown until 1668 when Frederick IV ceded it to Frederik Giese in exchange for land elsewhere.
After his death in 1693, Giesegaard was taken over by his widow Margrethe Elisabeth Schönbach and son Christoffer Joachim Giese.
Christoffer Joachim Giese died in 1719 and his mother had to cede the estate to her debitor Christian Scavenius.
He ran into economic difficulties and was forced to obtain a loan from countess Anna Sophie Schack in 1726, the same year that he was appointed to prefect of Ribe County.
She founded Stamhuset Giesegaard [da] in her will with the effect that the land could not be sold or divided between heirs.
He died on a journey to Karlsruhe in 1821 and Giesegaard was then passed on to his nephew, Henrik Adolph Brockenhuus-Schack, who was made a count the following year.