Lazarus David had died in 1776 but on August 14, 1777 his widow, Phoebe, sold for 1200 French livres part of David's property to three of the congregation's leading members, Samuel Judah, Simon Levy and Andrew Hays, recently married to her daughter Abigail (Branny).

The building, completed the following year, stood behind a low stone wall, had a high red roof, and was located at the junction of Little St. James and Notre Dame Streets, a site now partially occupied by the Palais de justice.

The Judeo-Egyptian style temple-like building had a front of cut stone, adorned with a portico with two columns.

Charles T. Ballard, architect, designed a new and larger synagogue for the Spanish and Portuguese Congregation on Stanley Street in the Egyptian Revival style of architecture in 1887–1890.

The ornamentation features symbols such as Stars of David, signs of the zodiac and natural forms.