Parish records indicate that in 1844 the first priest known to attend the sick and say an occasional Mass in the area of Northeast and Amenia was Fr.

Orsenigo, masses were held in private homes around the village while preparations were made to build a church.

Tandy became the first resident pastor in 1864 and established the first Immaculate Conception Church in 1868 presiding over the additional missions in Pawling, Dover Plains, Millerton and Millbrook for twelve years.

In 1870, several Irish Catholic families settled in Pine Plains, who would take the train to Millbrook and the mission of St. Joseph.

Over time a priest would travel from Immaculate Conception in Amenia to celebrate Mass in a private home in Pine Plains.

Lavelle was pastor in Amenia; parishioners in Pine Plains would bring him to St. Anthony's by horse and buggy.

As of August 1, 2015, the parish merged with Immaculate Conception, although Masses and sacraments will continue to be celebrated at St. Anthony's church.