The descendant of a family of scholars, he pursued his rabbinical studies at the yeshivot of Ujhely, Verbé, and Eisenstadt (the latter under the direction of Israel Hildesheimer).

Horovitz was appointed to chair a committee on ritual to placate the Orthodox followers of Samson Raphael Hirsch, who were threatening to found a separate community, the Israelitische Religionsgesellschaft ("Religious Society of Israelites").

He was given authority over the entire community's religious institution, and promoted the construction of a new Orthodox synagogue on the Börneplatz, which was dedicated on 10 September 1882.

Horovitz promoted coexistence between the different factions, maintaining that it was possible for a unified community to exist while both sides exercised autonomy over their own institutions.

Besides numerous sermons, and essays on the origin of the Hungarian Jews (in Izraelita Közlöny, 1869), Horovitz published the following works: