Despite being occupied successively by a women’s prison, a hospice until 1869, when it was transferred to Santa Clara, an infant school, as well as other activities designated by the Town Council, the building gradually deteriorated until it fell into ruin and by 1846 some of its materials were being used to pave streets.

On 12 March 1874 the Town Council, presided by Fermín Brey, applied for another concession in order to completely demolish the building and extend the property to the plot at the Fair Ground.

This concession was approved by the Civil Governor and President of the Provincial Commission of Monuments, but on the condition that the part corresponding to the old church and other elements of interest be conserved.

This decision prompted José Casal y Lois, a member of the Commission of Monuments, to intervene in October in the name of other illustrious figures from Pontevedra, before the Governor Filiberto Abelardo Díaz, who ordered the Mayor Alejandro Abreu to halt the demolition work.

Saved from demolition, the site was declared a National Monument by the Law of 14 August 1895, which stipulated that the Commission of Monuments would take over control of the building and that the Ministry of Development would implement "the appropriate provisions to ensure its conservation, decoration and custody", exactly one year after the foundation of the Pontevedra Archaeological Society, presided by Casto Sampedro y Folgar, on 15 August 1894.