[1][2] Gazi was born in 1924 in Shara, Satkhira District, East Bengal, British India.
He was born into a hunting family, his father was Meher Gazi, a notable tiger hunter who had killed 50 tigers and from who he inherited a muzzle loading double barrel rifle.
He killed his first tiger when he was 17 in Paikgachha Upazila, Khulna District.
He used a number of methods to hunt tigers, including killing them from tree tops.
He was viewed by honey collectors and others working in the forest as a saviour for protecting them from tigers.