He was a member of the United States men's national artistic gymnastics team and competed at the 1932 Summer Olympics in Los Angeles where he received a gold medal on the rings.

[2] As a youth in Latvia, Gulack divided his time between gymnastics, becoming the national all-around champion in 1921, and pole-vaulting but after immigrating to America around 1922 he narrowed his focus, and competed exclusively as a competitive gymnast.

[3] His best event was the rings, taking the Olympic gold medal in 1932 at the tenth Olympiad in Los Angeles as well as two national titles; one in 1928 as recognized by the American Athletic Union,[4] and one in 1935.

In 1948 he helped the American Athletic Union (AAU) design a new set of rules to conform to international standards.

Abie Grossfeld, the Assistant Head Coach of the Men's team was particularly displeased with Gulack's insistence that the wives remain on the multi-city Japanese tour, and another member of the Gymnastics team, Ron Barak felt strongly his wife should be allowed to leave as she had dysentery.