In the 1850s it became a retreat for King Frederik VII and his morganatic wife Countess Danner, who sought refuge there to escape the controversy their marriage had caused among the establishment in Copenhagen.

In the years around 1770 the sculptor Johannes Wiedewelt erected a large number of monuments in the park commemorating famous Danish and Norwegian men and women.

In 1679, the castle passed back into royal ownership and shortly after Frederick IV's ascent to the throne in 1699, he used it as a summer residence for a few years but then gave it to his younger brother Prince Charles of Denmark in 1703.

King Frederik VII acquired Jægerspris Castle on 21 April 1854, the birthday of his morganatic wife Countess Danner, as a place to spend their private life, away from the controversy their liaison had caused back in Copenhagen.

In the years around 1770 the sculptor Johannes Wiedewelt erected a large number of monuments in the park commemorating famous Danish and Norwegian men and women.

The large oak trees in the southern section of the park were planted by Frederik V to ensure the availability of timber for naval construction.

The castle and its park is the main location of the Danish feature film I Tyrens tegn (1974), the second of the Zodiac-films which famously combine hardcore sex and 'folk comedy', with many familiar mainstream actors in the cast.