Sherf played basketball with the Maccabi Tel Aviv youth teams, starting at age 12.

In 1984, (at the age of 33), he became the senior men's Israeli national basketball team head coach.

His first Israeli national team coaching tenure (which lasted three years), saw two EuroBasket appearances (1985, 1987) and Israel's historic 7th place finish at the 1986 FIBA World Basketball Championship.

Sherf's coaching career includes a Saporta Cup title with Aris Thessaloniki (1992–93), three EuroLeague Finals appearances, 10 Israeli League championships, and six Israeli State Cup titles (all with Maccabi Tel Aviv).

On April 10, 2018, Sherf returned to Maccabi Rishon LeZion for a third stint, replacing Shmulik Brener.