Being located in downtown Belgrade, it is surrounded by important city buildings and localities: House of the National Assembly, Nikola Pašić Square, Dom Sindikata on the north, former royal courts of Stari Dvor and Novi Dvor, Andrićev Venac, Terazije on the west, London on the southwest, Krunski Venac on the south, Tašmajdan on the east.

Easternmost point of the park, at the crossroad of the Bulevar Kralja Aleksandra, Kneza Miloša and Takovska streets, it the tripoint of the municipalities Vračar, Stari Grad and Palilula.

However, Austria didn't demolish the buildings outside of the fortress walls, including the Great military hospital, which, albeit as a ruin, survived until the next Austrian occupation in 1788.

Simić drained the marsh, filled and leveled the terrain and on the northern side of the modern Kralja Milana street constructed a house 1840-42.

Development of the first Serbian royal compound began in 1843-43, when the ruling prince Alexander Karađorđević purchased the konak with the surrounding garden.

Due to the construction of two palaces next to it, and constant change of the ruling dynasties, the Karađorđević and the Obrenović, chronicles were mostly concentrated on the rulers and the buildings, not the garden.

A part of the garden spreading from the Stari Dvor down Dragoslava Jovanovića, Bulevar Kralja Aleksandra and Kneza Miloša, up to the former Ministry of Army, was enclosed with an over 3 m (9.8 ft) high fence.

During the garden decoration, the English landscape – free style was applied in Serbia for the first time, conditioned with the existing vegetation in that area.

The planted trees in the garden advanced over the time, so this part of the park is nowadays rich in the most significant and the oldest vegetation.

The construction of the new royal palace, Novi Dvor, for Crown Prince Alexander, designed by Stojan Titelbah (1877–1916), began in 1911 on the outskirts of the garden.

The building suffered substantial damage during the war and was thoroughly rebuilt in 1919–22 under the supervision of a special commission which also oversaw the renovation of the Stari Dvor.

[8] Their sons, princes Peter, Andrew and Tomislav often played war in the garden on the object believed to be an Observation Post of the Serbian Army High Command on Kajmakčalan.

The authenticity of the Observation Post can't be confirmed, just like the popular tale of it being made from the real stones brought from the Kajmakčalan mountain in 1928.

After Red Army participated in the liberation of Belgrade in October 1944, Soviet soldiers discovered his grave, exhumed his remains which were reinterred in Moscow, with heroic honors.

One of the most important projects of this reconstruction was orienting the former court complex towards the National Assembly building, thus realizing the idea about the forming of the representative administrative centre.

[1] An area between the park and the Kralja Milana street, east of the Novi Dvor, was arranged as an modernist, artistic promenade with an artificial stream and named after the writer Ivo Andrić, Nobel laureate, Andrićev Venac.

[17] At some point, city owned company "Zelenilo", which administers the green areas, began marking its anniversaries by planting rare and uncommon species from all over the world in the park.