The gardens were established in the 1930s by socialite and huntsman Harvey S. Ladew (1887–1976), who in 1929 had bought a 250-acre (100 ha) farm to build his estate.

The house and gardens are open April through October, weekdays and weekends; an admission fee is charged.

The grounds contain 15 garden rooms, each devoted to a single color, plant or theme, arranged around two cross axes with vistas.

The garden is particularly noted for its topiary, which was strongly influenced by Ladew's extensive travel in England, where he frequently went fox hunting.

[2] Both the grounds and house, which contain a good collection of antique English furniture, opened to the public in 1971.