In 1907 Margolis immigrated to the United States, settling in Boston, where he served as chief rabbi of seven local congregations.
[1]: 72 He was soon thereafter appointed as New York's Chief of Rabbinic Courts and was the founder and president of the Knesseth HaRabbonim (Assembly of Hebrew Orthodox Rabbis) for 25 successive years.
He was involved in a number of disputes in his lifetime due to his religious views, and frequently sparred with many other rabbis in the city over communal matters.
)[7][8] His funeral was attended by more than 10,000 people in front of his synagogue and home, stretching a quarter mile down the streets of the Lower East Side, and he was buried on the grounds of Adas Yisroel of New York United Hebrew Community of New York in Montefiore Cemetery in Queens.
[9] Joshua Hoffman wrote a thesis entitled: "The American Rabbinic Career of Rabbi Gavriel Zev Margolis".