The arboretum was begun as a landscape garden in the years 1776-1793 by Karl Eugen, Duke of Württemberg, on a site southwest of Schloss Hohenheim.
After the Duke's death in 1793, the garden was opened to the public, and during the nineteenth and early twentieth centuries was used for cultivation of seedlings for the Duke's gardens, study of exotic trees for local forestry, and student botanical studies.
Its collections were substantially enhanced beginning in 1996 when an adjacent 7.4 hectares were devoted to a new Hohenheimer Landschaftsgarten (Hohenheimer Landscape Garden), with first trees were planted in 1997 and an additional 200 plants added in 1998.
Today's arboretum comprises two linked sections, the old Exotischer Garten and the newer Hohenheimer Landschaftsgarten.
Particularly noteworthy are historic specimens dating to the arboretum's creation, including tulip trees planted in 1779, oaks (1790), and yellow buckeye (1799).