The village was first mentioned in 1634 as "de akkers in 's Graevenlandt" and means "the land of Count of Holland" (Albrecht van Beieren) and served as a hunting ground.

[4][5] A popular location for the country estates of Amsterdam burghers, the village contains several historic houses dating mostly to the 17th century.

In 1644, a regular barge to Amsterdam was introduced, and not long after, a school and church were built, designed by Daniel Stalpaert.

The village became a popular location for wealthy families from Amsterdam, who bought, built or inherited villas and estates there.

Most of these villas remain in s'Graveland, including Trompenburgh, a mansion in Dutch Baroque style built for Cornelis Tromp and designed by Daniel Stalpaert.