One of his forebears had served as an emissary for Sweden to Ivan the Terrible, and had been rewarded for this service with lands in Estonia.
Toll began his military career in 1796 after a period in the infantry cadet corps under the command of Mikhail Kutuzov.
He fought at Austerlitz, in the Turkish campaigns from 1806 to 1809, and in the War of the Sixth Coalition, notably at Leipzig.
For his role in the victory at Kulevicha he was granted the title of count by Tsar Nicholas I.
Count von Toll was the landowner of Aruküla Manor (German: Arroküll) in present-day Estonia, which he rebuilt in a neoclassical style.