Stout became most famous riding for Belair Stud and trainer Sunny Jim Fitzsimmons.

His highly touted colt Granville was a victim of one of the roughest starts in Derby history, and he was thrown from the horse.

[3][4] Among his other major racing successes, he won the Jockey Club Gold Cup on two occasions.

[5] In 1946 he returned to his native New Jersey to ride at Monmouth Park Racetrack in Oceanport where he was the leading rider for four years.

Jimmy Stout died on July 12, 1976, of a heart attack in Harrisburg, Pennsylvania, where he had been working as a racetrack steward.