Though raised in Baptist circles, in his early twenties, Rogers joined the Religious Society of Friends (Quakers).
But he met with no encouragement from the overseers of the meeting so he dropped the subject for a time.” [3] However, the sense of calling remained and “Rogers came to Yonge Street from Vermont in 1800….
"[4] This group of pioneers met all the conditions of land grants and by 1804, they were also recognized as an official meeting of the Religious Society of Friends.
“ [5] There were already Quaker colonies at Pelham in the Niagara Peninsula and Adolphustown on the Bay of Quinte that had been started by refugees fleeing persecution by Patriots during the American Revolutionary War.
[6] Rogers started by buying 800 acres and then moving “his family from Yonge Street to Duffin’s Creek, where he operated what was probably the first grist and saw mill in the township.” [7] In 1810, he “went back to the United States and returned with another company of settlers who were settled in Pickering Township, east of Duffin’s Creek.