In 1816, the initial settlement of Bathurst was established on the eastern banks of the Macquarie River, in current-day Kelso.

The first ten farmers in Kelso were each given 50 acres (20 ha); five were newborn colonials and five were immigrants.

The church has a close association with early settlement west of the Great Dividing Range.

The church is surrounded by an historical cemetery, which contains many of the Kelso/Bathurst district's pioneers.

Kelso previously had a railway station on the Main Western line.