The first building constructed by Rodeph Sholom, at 8 Clinton Street on the Lower East Side in 1853, is still in use by Congregation Chasam Sopher.

[1] Rodeph Sholom moved to Lexington Avenue and 63rd Street, to a new Victorian Romanesque building designed by D. & J. Jardine and built in 1872–73 for Ansche Chesed.

The move was supervised by Mitchell Fisher; then acting rabbi of the congregation, he would resign a month later due to what he described as "institutional restraint".

[6] The Romanesque Revival temple house and sanctuary, designed by Charles B. Meyers, were built between 1929–30 and dedicated on Purim in March 1930.

[7][8] Modern renovations to the lobby and multi-purpose room, overseen by MBB Architects and Chicago-based Judaica expert Amy Reichert, improved the building's accessibility and introduced new artwork.