It is located in the old walled city, the Harar Jugol, which is a UNESCO World Heritage Site.

Archaeological excavation within the mosque perimeter has not been permitted.

[3] The Jamia Mosque was extensively remodeled with the addition of a second minaret in the 16th century probably during the reign (1528–1543) of Ahmad ibn Ibrahim al-Ghazi, whose gravestone is in the prayer hall.

An inscription on the wooden minbar indicates that this was constructed in 1175/1761, i.e. during the reign of Amir Ahmed.

During the Italian occupation (1936–1941) a water pool was added to the courtyard on the east side of the mosque.