A resident of Safety Harbor, Florida, he was the operator of a public stable based at nearby Sunshine Park.
He was described in a February 14,1960 Ocala Star Banner article as a quiet spoken man who did not seek to "bask in the limelight."
The newspaper referenced a 1959 magazine article by John Lardner about his reputation and a trainer who had accomplished the remarkable feat of keeping a horse named Bee Lee Tee sound and still racing at the age of 12.
Owned and trained by Pitt, on March 14, 1959, the gelding had surpassed the $100,000 mark in career earnings, an amount close to $1,000,000 in 2021 dollars based on inflation.
[1] [2] His success with Bally Ache led to the Florida Turf Writers Association voting Jimmy Pitt the state's outstanding trainer of 1960.