The synagogue was situated in the heart of Little Tel Aviv, but today it stands in the city's bustling business and financial district.

With the outbreak of World War I, Michael was unable to complete the project and was replaced by Alexander Baerwald, a Jewish German architect.

Construction finally commenced in 1924 based on the plans of Yehuda Magidovitch and was completed in 1926 with support from a donation by Baron Edmond James de Rothschild.

In 1969, architect Aryeh Elhanani led a renovation that modernized the synagogue, adding arches and updating the interior to reflect contemporary tastes in architecture and design.

The caretaker, Eliezer Neuman, was subsequently detained by British military authorities and sentenced to a one-year term.