Born in Little Rock, Marion (now Dillon) County, South Carolina, Stoll attended public school.

With the outbreak of World War I, he was commissioned as a major in the Judge Advocate General's Department of the United States Army in 1917.

Stoll was elected as a Democrat to the Sixty-sixth Congress to fill the vacancy caused by the death of J. Willard Ragsdale.

Stoll was elected as a judge of the third judicial circuit of South Carolina in 1931 and served until December 6, 1946, when he retired.

In 1944, Judge Stoll sentenced 14-year-old George Stinney, the second youngest person executed in US history, to death after a 1-day trial and a 10-minute deliberation by an all-white jury.