The mosque is believed to have been built by the Wali Songo ("Nine Muslim Saints") with the most prominent figure, Sunan Kalijaga, during the first Demak Sultanate ruler, Raden Patah, during the 15th century.

[1] Although it has had several renovations, it is thought to be largely in its original form except for the addition of a verandah or surambi in the nineteenth century.

Rather than a dome, which did not appear in Indonesian mosques until the 19th century, the roof is tiered and supported by four saka guru teak pillars.

The tiered roof shows many similarities with wooden religious structures from the Hindu-Buddhist civilizations of Java and Bali.

The main entrance of Masjid Agung Demak consists of two doors carved with motifs of plants, vases, crowns, and an animal head with an open wide-toothed mouth.