When Erik Jensen Mun died, his son Peder Lykke, inherited the estate and managed it until his death in 1464.

[2][3] King Frederik II bought the manor in order to expand his hunting grounds around Skanderborg Palace.

In 1661 the fiefdom - and Constantinsborg - were given to the Dutch merchant Gabriel Marselis in part-payment for debts incurred by the Danish state during the Second Northern War.

[4] In 1699, Constantin Marselis died and his widow Sophie Elisabeth Charisius took over the manor and had it turned into a fee tail.

[2] In 1787, Hans Frederik Fædder-Charisius took over Constantinsborg and was given permission to divide and sell the manor estate provided all profits were set aside for his descendants.

In 1851 he was made Consul of the Danish state and he co-founded Aarhus Privatbank which eventually became one of the largest banks in Denmark.

The present main building was constructed in 1801 in Neoclassical style and consists of a single, long brick structure.

The oldest part was built by Hendrik Pontoppidan Constantinsborg in 1870 and now stands next to a number of modern buildings from the 2000s, used for offices and administration.

When Hendrik Pontoppidan took over Constantinsborg in 1867 the garden was altered in the English style with free standing trees and large lawns, although the terraces were preserved.