He started a dynasty of Warsaw's benefactors, scientists and writers, which included his sons Zygmunt, Julian, Feliks, Stanisław and his grandson Roman, a renowned painter.
A renowned preacher, he was chosen as the first to preach in the newly opened reformist Polish Synagogue in 1852.
A supporter of closer ties between Jews and Poles, he also started teaching Talmud in Polish.
In 1861, during the events leading up to January Uprising, Kramsztyk was among the rabbis who showed solidarity with Catholic Poles, protesting against Cossack soldiers desecrating Warsaw's churches.
The funeral turned into a large patriotic demonstration and Kramsztyk was arrested by tsarist authorities.