[1] In 1957, Ali joined Sporting Union in the First Division of the Calcutta League under the recommendation of local trainer, Ramani Sarkar.
He spent five years at the club, nurturing future internationals such as Kaiser Hamid, Imtiaz Sultan Johnny and Ashish Bhadra.
[6] In 1981, he acted as the assistant coach of Arambagh KS only during Nepal's ANFA Cup and helped them finish runners-up.
[1] In 1987, Gazi was appointed Bangladesh national football team head coach for Pakistan's Quaid-e-Azam International Cup.
[4] Gazi led newly promoted Sheikh Russel KC to a runners-up finish in the 2003–04 Premier Division League.
[8][9] In 2005, he won the domestic double with Brothers Union, clinching both the Premier Division League and Federation Cup titles.
[18][19][20][21] Team BJMC Dhaka Mohammedan Jessore District East Pakistan Shantinagar Club Brothers Union Individual