The Gardens were formed on 1.4 hectares of land purchased by the Shire of Boroondara (Camberwell) in 1903 and designated as a municipal reserve.

In 1904, William Guilfoyle, designer of Melbourne's Royal Botanic Gardens suggested a plan that was later adopted.

Two cannons, humorously known as "Brook's Babies" are located at the highest part of the Gardens.

These were purchased by Arthur "Empire" Brooks in 1901 to commemorate the end of the Boer War.

The stone-clad Dimmick Gateway to the park in Union Road was completed in 1950, named after Cr.