His father Muhammad Ali Mungeri was the founder of Nadwatul Ulama and his son Wali Rahmani established the Rahmani30 institute.
[2] Rahmani received his primary education in Munger and went to Hyderabad, where he studied Arabic grammar, syntax and logic with Mufti Abd al-Lateef.
[4] Abul Muhasin Muhammad Sajjad founded the Muslim Independent Party in 1935 and Rahmani was appointed as its member.
[4] He was appointed as the Sajjada Nashin of Khanqah-e-Rahmani, Munger in 1361 AH and a member of the executive council of Darul Uloom Deoband in 1955, a post he served until his death.
[3][5] Alongside Muhammad Tayyib Qasmi, he played a key role in establishing the All India Muslim Personal Law Board and was appointed its first General Secretary on 28 December 1972, in the inception meeting.