The mosque grew quickly in the late 1940s and early 1950s, outgrowing its space and moving multiple times, before moving to its current location at 514 Wilson Street in the late 1950s.
On June 26, 1960, Elijah Muhammad spoke to over a thousand people during a visit.
The Islamic Society of Baltimore, originating in 1969 as a weekly congregation at Johns Hopkins University, constructed a mosque in 1982, Masjid Al-Rahmah, and opened the Al-Rahmah School in 1987.
The land they wanted to build the mosque on, however, was off-limits for development, and their appeal to the county commissioners to connect to the county water and sewer lines, which saw over 200 Muslim families present, was met with a tie vote, barring their ability to build a mosque.
The construction of the mosque was a six year endeavor due to city zoning rules and building regulations.