Sandhyakar Nandi in his epic poem Ramacharitam attests to the existence of the Sur dynasty family in the southern Rarh in the first quarter of the 11th century.
The same source, however, records the name of Lakshmishura, the lord of the Apara-Mandara (identified with Mandaran in the Hughli district) in the list of vassal chiefs who helped Ramapala.
Vijaya Sena's fight against Vir and Vardhan were perhaps meant to bring under control two other feudatory chiefs who also might have aspired for power.
The reference in the Deopara prashasti to the fight between Vijaya Sena and the king of Kamrupa does not necessarily mean that the former invaded the province, although that is not impossible altogether.
The king of Kamrupa, defeated by Vijaya Sena, was perhaps Vaidyadev, the minister of Kumarapala who declared independence, or his successor.
The lord of Gauda who was made to flee by Vijaya Sena was Madanapala, the last known Pala king whose authority was, at that time, confined to north Bengal.
It is learnt from the Pala epigraphic records that Madanapala's authority over north Bengal continued up to the 8th year of his reign, which falls in 1152–53 AD.
It is recorded in the Deopara prashasti that he erected the magnificent temple of Pradyumneshvar at the find-place of the inscription, about 7 miles to the west of Rajshahi town.
So it seems probable that Vijaya Sena ousted the Varmans from southeastern Bengal in the middle of the 12th century AD.
Thus by the middle of the 12th century AD Vijaya Sena supplanted the Varmans, ousted the Palas and succeeded in establishing the rule of his own dynasty over the whole of Bengal.