The church and adjacent rectory are two 19th-century buildings that were extensively altered by architect Alfredo S. G. Taylor in 1925.

The property was listed on the National Register of Historic Places in 1982 for its association with the architect.

The Church of the Immaculate Conception stands on the northern edge of the village of Norfolk, on the east side of North Street (Connecticut Route 272) at its northern junction with United States Route 44.

[2] The alterations of the original church building were designed by Alfredo S.G. Taylor, a New York City architect who summered in Norfolk for several decades in the early 20th century.

[3] It typifies Taylor's use of stone in many of his designs, with the stucco serving to give the building a somewhat Spanish Revival appearance.