Some Muslim scholars, including al-Azraqi, claimed that 'Amr ibn Luhayy, the patriarch of the Arab tribe Banu Khuza'a, who introduced idolatry in Mecca, was responsible for the worship of Isāf and Nā'ila.
Ibn al-Kalbi handed down the legend in his Book of Idols as follows: They set out to perform the pilgrimage.
Taking advantage of the absence of anyone else and of the privacy of the Sacred House, Isaf committed adultery with her in the sanctuary.
[3]According to the traditions of the Meccan local historian al-Azraqī, the incident happened at the time when the Arab tribe of the Jurhum ruled over Mecca.
The two stones were removed from the Kaaba and placed on the Al-Safa and Al-Marwah hills so that the people would be warned.