When he was nineteen, he joined the theology class of the London Missionary Society in Xiamen.

By 1987, his health had begun to decline, and was advised to migrate to the warmer climate in Singapore.

In 1908, he began a church in Seletar with land provided by Teo Eng Hock.

He was involved in the local revolutionary dramatist movement and was one of the organisers of the "Fang Ai Pan", which translated to the Universal Love Troupe.

[2] After his health further deteriorated, Tay gave up the work of his pastorate and instead turned to the rubber industry, becoming the director of Han Yang Plantations Ltd., which was set up by Lim Boon Keng and Lim Nee Soon, for a while.