[9][8] Sime applied to the United States Military Academy at West Point, as his dream was to become a pilot, but discovered he was color blind and accepted a baseball scholarship to Duke University in North Carolina.

[10] Sime was a member of Duke's baseball and track and field teams, and played football for a season in 1958 while a first-year medical school student.

Parker was a former multi-sport athlete and recognized the exceptional speed and Olympic potential; Sime focused on track in 1956, then split time between both sports in 1957.

[10][17] Sime was selected by the Detroit Lions in the 29th round (341st overall) of the 1959 NFL draft, but he opted not to play football professionally and continued at medical school.

[10][19] Four years later (and midway through medical school), he competed in Rome and won a silver medal in the 100 meters, edged out by Armin Hary of Germany in a photo finish.

His son Scott was a state wrestling champion and all-state football player at Coral Gables Senior High School before going on to his father's alma mater at Duke, where he was a starting fullback.