In 1912, the 39 Catholic families of Scarsdale petitioned the Archbishop of New York, Cardinal John Murphy Farley, to create a new parish in the village.

[2] The cornerstone of the school building was laid on December 11, 1927, and the it came to accommodate nine classrooms, a library, auditorium, and gymnasium.

The Immaculate Heart of Mary School, staffed by the Sisters of Charity, opened for its first 100 students on September 10, 1928.

It was dedicated by Cardinal Patrick Joseph Hayes, who was led in a procession from the Scarsdale Train Station to the school.

In 1972, this order was succeeded by a lay administration, making Immaculate Heart of Mary the first lay-administered school in the Archdiocese of New York.