Although the community did well, a severe drought afflicted the region beginning in the late 1660s, which combined with attacks from hostile Apaches to lead to its abandonment in 1675.

[3] The Quarai survivors eventually migrated to the Rio Grande valley south of what is now Albuquerque.

The Luceros and other local ranchers used the church (which at the time still had its roof) for services led by itinerant preachers.

This was granted, but disagreements among the residents and with the authorities led its construction to be halted at an early date; it was built at Manzano instead.

The Lucero settlement was abandoned after a major Apache raid in 1830, one of whose effects was the collapse of the church roof.