Under influence of his and some other spiritual young boys, he started to go to Belur Math frequently and he met many of the direct disciples of Sri Ramakrishna.
This made him leave his residence and he built a Shiva temple in Baghbazar (Calcutta) and lived there like a renunciate monk, practicing intense Tapasya.
In 1921 Saradananda (direct disciple of Sri Ramakrishna) initiated Vijay with Mantradiksha at the Mother's house.
Some books have been published from his lectures and class talks, of which Sri Ramakrishna Kathamrita Prasanga (in six vols.
), Mundakopanishad, Kathopanishad, Upanishad O Ajker Manush, Sharanagati (all in Bengali) and Thoughts on Spiritual Life (in English).
[1] During twenty-three years as vice president and President of the Order he travelled to many countries including Singapore, Fiji, Japan, Australia, America, Canada, England, France, Bangladesh and Sri Lanka, and carried the ideals and ideas of Ramakrishna-Mother-Vivekananda to innumerable people.