By 1869 the population had reached 265, and it stayed stable for a few years, but after that people began moving to the mainland, and to places like Wesleyville.
In 1896, Swain’s Island was unable to find a schoolteacher willing to teach there, and so a ferry service was established to take children to attend school in Wesleyville.
[1] When Swain's Island was first settled, the entire population belonged to the Church of England.
Feltham agreed to this, and sometime later, in 1829, he was appointed by the Society for the Propagation of the Gospel in Foreign Parts (S.P.G.
In 1869 a new school house was built; and the last teacher to teach at Swain's Island was Annie Alice Hall in 1901.