[1] Globally, he fought for the survival and transplantation of European Jewry as an activist in the Vaad Hatzalah and the Agudath Israel.
Goldstein and his family were members of Beth Hamedrash Hagadol, where he had his Bar Mitzvah, and met his future father-in-law, Harry Fischel.
He received rabbinic ordination both from Rabbi Shalom Elchanan Jaffe of Beth Hamedrash Hagadol, and from the Jewish Theological Seminary.
He was president of the Keren Hayishuv, the American Religious Palestine Fund, and of the Save-A-Child Foundation, which evolved into the Homes for Children in Israel; He was co-founder of the National Conference of Christians and Jews, and was one of the leading English-speaking fund-raisers in the Orthodox Jewish community when it was still dominated by Yiddish-speaking foreign born individuals.
He also headed the homiletics department for decades at the Rabbi Isaac Elchanan Theological Seminary, Yeshiva University's affiliated rabbinical school, guiding the first generations of America's American-born and educated orthodox rabbis, having joined its staff shortly after he was ordained before World War I, and continuing until the early 1960s.