One origin was a clan name taken from a fief north of Shaanxi granted to Ji Sun, a descendant of King Wen of Zhou.

Another source was a cadet branch of the ruling House of Mi (芈) of the State of Chu during the Spring and Autumn period.

Members of the Plains tribes adopted the surname Pan as a modification of their designated status as barbarians (番, Fan).

During the reign of Phan Huy Ich, he moved to Sai Son, Quoc Oai (Da Phuc village) to settle[2].

This family has long settled in Vong Son village, Tung Anh commune, Duc Tho district, Ha Tinh province.