The Shrine of St. Elizabeth Ann Bayley Seton is located in the Church of Our Lady of the Holy Rosary, a Roman Catholic parish church of the Roman Catholic Archdiocese of New York at 7 State Street, between Pearl and Water Streets in the Financial District of Manhattan, New York City.

[3] After the Civil War, Irish author Charlotte Grace O'Brien bought the James Watson House to be the Mission of Our Lady of the Rosary, which served as a way station for young immigrant girls.

Our Lady of the Rosary is an atypical parish, with no significant resident population.

The church is located next to the James Watson House, a New York City landmark[9] which is also listed on the National Register of Historic Places.

Built in 1793 and extended in 1806,[9] the eastern portion is the work of an unknown architect, and the western half is attributed to John McComb, Jr.[1] In 1975, the house became the Rectory of the Shrine.