After the handover of Taiwan from Japan to China in 1945, the Chinese Muslim Association (CMA) in Nanking appointed Chang Zichun (常子春), Wang Jingzhai (王靜齋) and Zheng Houren (鄭厚仁) to form the preparatory committee of the CMA branch in Taiwan on 23 December 1947.

2, Lane 17, Lishui Street (麗水街), Da'an District, Taipei City by converting a Japanese-style house into a 992 m2 prayer area.

[3] In the latter part of the 1950s after the end of Chinese Civil War and the relocation of the Nationalist Government from Mainland China to Taiwan, Director-General of the CMA Bai Chongxi and ROC Minister of Foreign Affairs George Yeh proposed the construction of a bigger Islamic-style mosque which was designed by the famous architect Yang Cho-cheng.

[4] Under the leader Bai Chongxi, director-general Shi Zizhou (時子周) and the board chairman Chang Zixuan (常子萱), the mosque was constructed by the Continental Engineering Corporation on a 2,747 m2 land donated by the government at the Xinsheng South Street (新生南路).

ROC Vice President Chen Cheng led the inauguration ceremony of the mosque on 13 April 1960.

[7] The congregation had already repaid half of the bank loan by that time when the ROC government decided to exempt them from having to repay the remaining.

[8] The mosque has been visited by other head of states, such as King Hussein of Jordan, Prime Minister Tunku Abdul Rahman of Malaysia and many other prominent Muslim leaders.

[11] Speaking at the mosque in December 2001 during Eid al-Fitr, Mayor Ma thanked the Indonesian workers for their contribution to Taiwan and gave them festive greeting.

[12] On 25 December 2015, vice presidential candidate Wang Ju-hsuan visited the mosque as part of her election campaign.

[16] Taipei Grand Mosque houses the headquarter of CMA, the largest Islamic organization in Taiwan.

The mosque receives funding to run most of their Islamic activities and cover daily operating costs from private donations.

The Vice-Imam of the mosque Ishag Ma (馬孝棋) said that the event is not only a cultural celebration, but also as an invitation to those Taiwanese who no longer practice their Muslim faith, such as those living in Lukang Township in Changhua County.

[19] The mosque also holds inter-religious workshops and debates between Islam and Confucianism, Catholicism and Buddhism to promote mutual understanding with other religions.

[17] People First Party Muslim legislator Liu Wen-hsiung's body was sent to Taipei Grand Mosque, where a funeral prayer was performed before he was buried, after his death on 31 July 2017.

[30] It can accommodate up to 1,000 worshippers and is adorned with handmade Persian rugs and chandeliers, presented by kings of countries friendly to the ROC.

The mosque is accessible within walking distance south of Daan Park Station of Taipei Metro.