The gardens were created as an ornament to the grand summer estate Runnymede-by-the-Sea by businessman and Massachusetts governor Alvan T. Fuller.

The original design was by Arthur Shurcliff, who was the architect of record when the estate was built in 1927.

The Olmstead design was in the Colonial Revival style and includes many statues and fountains that were collected by Fuller during his travels through Europe.

The summer estate was removed in 1962 due to the wishes of Fuller, so that visitors to the gardens could have an unobstructed view of the Atlantic.

Daily admissions and a large member base help support nearly half of its operating costs.