In Tevet 1874, he became very ill and viewed his recovery as a miracle, which he addressed in the introduction to his book "Kapei Aharon" which he was working on publishing at the time.
He wrote: And now I will remember the kindnesses of God, praises like for all rewards, for in this past harsh winter, on the 10th of Tevet I fell ill and I was like suspended between life and death - may the Merciful One save us...
In his later years, he suffered a heart attack and moved to live in Jaffa on the advice of his doctors, in the hope that the proximity to the sea would improve his condition.
[5] After the mourning period ended, he remarried[6] and had: Raphael Yehoshua Azriel, who married Levanah the daughter of the Rishon LeZion Jacob Meir, and Sarah who married Israel Chafetz, one of the leaders of the Bukaharan community in Jerusalem and the son of David Chafetz, the first immigrant from Bukhara who arrived in Eretz Yisrael with his family in 1871, and settled in the courtyard of Rabbi Aaron Azriel.
His grandson from his son Moses was Rabbi Abraham Azriel, head of the Sefardi Beth Din and administrator of the Shevet Achim Yeshiva.