The mosque was founded by Kazi Syed Tajuddin, a descendant of the Islamic prophet Muhammad, who came from Yemen during 13th century and received this land from the King Kulasekara Ku(n) Pandiyan.

[4] The mosque, which can accommodate about 1,200 people, is within 500 metres of the Periyar (central) bus stand, within one kilometre southeast of Madurai Junction railway station[5] and 1.5 km southwest of the Meenakshi Temple.

Founder's day (Urus anniversary of Qazi Syed Tajuddin) is celebrated in this mosque every year on 15th of Rajab with great fervour.

Sheikhuna Meer Ahmad Ibrahim well known as Periya was appointed as Chief Qazi (Qaziyul Quzzat) of Madurai by the government of Nawab of Arcot.

As such the huqdars of this mosque have been appointed as Kazis of Madurai to the government continuously since 13th century from the period of Qazi Syed Tajuddin till today.

The service of presiding the daily prayers and Friday sermons (Imamat and Qitabat) are done by the descendants of the founder Qazi Syed Tajuddin, from his period until today.

Kazi Syed Tajuddin Arabi Madrasah is located inside the mosque campus in which around 120 students learn basic Arabic.