At the end of the thirteenth century, Bygdøy was purchased from the Hovedøya monastery by King Haakon V of Norway as a gift for his wife, Queen Euphemia of Rügen.

The current main building was erected in 1733 as a summer residence and maison de plaisance for the Governor-general of Norway, Christian Rantzau (1684–1771).

Following the establishment of the Swedish-Norwegian Union, King Charles III purchased the remaining estate grounds from the Norwegian government in 1837.

The royal family would later use the estate as a summer residence, a tradition which was continued by King Olav V and later Harald V.[6] A comprehensive restoration of the main building and gardens began in 2004.

The buildings and gardens have undergone extensive refurbishments and the estate is again set to be the regular summer residence of Harald V and Queen Sonja .