In 1925, with the growing number of Jewish immigrants congregating in the Lower East Side, Streit, along with his two sons, Jack and Irving, moved his business to nearby 150 Rivington Street.

Streit's 47,000-square-foot (4,400 m2) matzo factory, along with Katz's Delicatessen and Yonah Schimmel's Knish Bakery, was a surviving piece of the Lower East Side's Jewish heritage.

However, because of the poor living conditions, as soon as they financially could, many Jewish families moved out of the tenements to other areas in New York City, namely uptown and Brooklyn, slowly making Streit's a relic of the past.

[3][11] The Streit family even considered at one point opening a café or bar that serves matzo, to go with the Lower East Side's new nightlife scene.

[13] The Streit's family cited noise complaints, congested streets, and their desire to modernize its equipment as the reasons for their eventual move.

Its realtor, Massey Knakel Realty Services, commented "the building will most likely be torn down and converted into luxury condominiums.