It was a small and humble building containing "the image of Our Layde, graven in wode, the image of St Matthew unto whom it is dedicated and there stood in the street nigh to the chapel door one cross of stone, very finely graven with fretted work."

[5] According to History, Directory & Gazetteer of the County of York (1822), "[the second chapel] was taken down and handsomely rebuilt about five and thirty years ago."

[5] The modernisation of the church interior began in 1875 under the direction of William Swinden Barber, and a renovation and a re-decoration were carried out in 1935.

In the chancel, the communion table was replaced with an altar and the inscribed tablets on the east wall were replaced with the frieze depicting "Goodly Fellowship of the prophets and Glorious Company of the Apostles".

[2] In 1907, Hugh Travis Clay (1875–1957) gifted the church a beautiful limited edition copy of the 1903 Prayer Book prepared for King Edward VII, he also dedicated the East window around 1889.