Father Luigi Paroli, CS obtained permission by Bishop Matthew Harkins of the Roman Catholic Diocese of Providence and was installed as the first pastor of the parish.
In 1901 the congregation grew too large for its current dwelling and a number of lots were purchased on the corner of Knight Street and Atwells Avenue at the west end of Federal Hill.
A one level structure what today is the present church's basement served as the main place of worship for devotees until the triforium, edifice and campanile were constructed eight years later.
The center terracotta pediment sculpture and frame, above and around the church's main doors depicts the first Pentecost Sunday, the Virgin Mary at the center of the Apostles, seated below a dove depicting the Holy Spirit the sculpture is topped off with a cross and two mini statues on either side frame the image, Saint Peter and Saint Paul was imported form Florence in 1909.
Father Parenti began commissioned artists to paint frescos over the drab white stucco and create niches and votives for statues and worshipers.
Additionally, golden mosaics were installed in the dome over the altar, and frescos were painted to amplify the spirituality of the dwelling, the project was headed by parish trustee and notable Italo-American architect, Oreste DiSaia.