The arboretum was established and endowed by the Scott family in 1929[1] in honor of Arthur Hoyt Scott (class of 1895, inventor of the paper towel), "for the purpose of enabling Swarthmore College to acquire, cultivate and propagate the better kinds of living trees, shrubs and herbaceous plants which are hardy in the climate of eastern Pennsylvania and which are suitable for planting by the average gardener."

Today the arboretum contains over 4,000 kinds of ornamental plants, labeled with scientific and common names, and grouped in collections for ready comparison.

It is "celebrated for its horticultural excellence and display" and "grants Swarthmore’s 1,500 students an academic life immersed in the plant kingdom, although the arboretum welcomes visitors as well.

"[2] Each year, the Scott Outdoor Amphitheater plays host to the commencement ceremony of approximately 350 graduating seniors.

Tulip trees "rise like columns" to create a sylvan take on the Classical Greek Amphitheater.