It is located in the Sher Darwaza hillside of District 5, southwest of Shahr-e Naw, or a short distance south of Kabul Zoo and north of Chihil Sutun.

The park is thought to have been developed around 1504,[2] when Babur gave orders for the construction of an "avenue garden" in Kabul, described in some detail in his memoirs, the Baburnama.

There are accounts from the time of the visit to the site of Shah Jahan in 1638 of a stone water channel that ran between an avenue of trees from the terrace below the mosque, with pools at certain intervals.

In an article written by the Aga Khan Historic Cities Programme,[6] describes the marble screen built around the tomb of Babur by Mughal Emperor Shah Jahan in 1638 with the following inscription: only this mosque of beauty, this temple of nobility, constructed for the prayer of saints and the epiphany of cherubs, was fit to stand in so venerable a sanctuary as this highway of archangels, this theatre of heaven, the light garden of the god forgiven angel king whose rest is in the garden of heaven, Zahiruddin Muhammad Babur the Conqueror.

The only hint of the design lies in an 1832 sketch and short description by Charles Masson, a British soldier, which was published in 1842, the year the tomb was destroyed by an earthquake.

One description of the tomb praised it, "although obviously in a poor state of preservation, reveals fine workmanship in stone carving: high walls with lavish jali-work and relief decoration.

"[10] Mason described the tomb as being "accompanied by many monuments of similar nature, commemorative of his relatives, and they are surrounded by an enclosure of white marble, curiously and elegantly carved... No person superintends them, and great liberty has been taken with the stones employed in the enclosing walls.

Zahra Breshna, an architect with the Department for Preservation & Rehabilitation of Afghanistan's Urban Heritage, argues that “emphasis should be on developing and strengthening the partially forgotten local and traditional aspects, whilst placing them in a contemporary global context.

Architect Abdul Wasay Najimi writes that "Restoration of confidence, pride and hope would be the main outcome in reintegrating the historic quarters in the mainstream rehabilitation and development of Kabul.

In addition to specific references to Bagh-e-Babur itself, contemporary accounts of types of trees and arrangements for the distribution of water were reviewed and advice was sought from those who have studied and undertaken rehabilitation work on other Moghul gardens in the region.

Since 2003, the focus of conservation has been on the white marble mosque built by Aurangzeb in 1675 to mark his conquest of Balkh; restoration of the Babur's grave enclosure; repairs to the garden pavilion dating from the early 20th century; and reconstruction of Tajbeg Palace.