Sometime after the building of the chapel in Holly Place, two schools, one for boys and the other for girls, were set up next to the presbytery and was supported by subscriptions from wealthier parishioners.

The sanctuary is decorated with tile mosaics and the painting of the Assumption of Our Lady was a gift from one of the founders of the chapel, George Armstrong, on behalf of his only daughter Frances Hall.

Considerable repairs were made to the presbytery (rectory) in 1978 so that the upstairs now houses the pastor and downstairs a parish centre.

Previously it was home to one of St Mary's more notable parishioners General Charles de Gaulle who lived there with his family for about a year during the Second World War.

The Sisters of St Dorothy's organise CCD classes for children of the parish who are not attending Catholic schools.