Gomelsky began his coaching career in 1949, in Leningrad, with the women's team of LGS Spartak.

In 1953, he became the coach of Rīgas ASK, leading the team to three Soviet Union League titles (1955, 1957, 1958), and three consecutive European Champions Cups (EuroLeague), from 1958 to 1960.

In 1970, he was appointed the head coach of CSKA Moscow, leading the club to 8 Soviet Union national league championships (1971–1974, 1976–1979), 2 Soviet Union Cups (1972, 1973), and one European Champions Cup (EuroLeague) title in 1971.

[2] The Soviet team, with Vladimir Kondrashin as their coach, won their first Olympic gold medal that year, after a controversial game against the United States.

His son Gomelsky [Alexandre] ran a sports association school in his father name, leading to several female Olympic basketball players.