In 1873, following the closure of W. H. Savigny's college,[4] Canon Thomas Smith of All Saints' Cathedral, Bathurst, with the support of Bishop Samuel Marsden began the process of starting the School.

The following year, on 27 January, the Bathurst Church of England College opened its doors to seven students under the headmastership of Henry Kemmis.

Renamed All Saints' College, the school officially came into being in mid-1875 when it moved to its permanent site on the corner of Piper and Hope Streets after a successful fund raising campaign and the Bishop's donation of land.

With their support, Tracey purchased the school from the Church, thus becoming its proprietor, a position he maintained until 1919 when he sold the land and buildings to the NSW Government.

[1] In 1923, the headmaster of Monaro Grammar School, Cooma, Lindsay Watson, and one of his staff, Colin C F McLeod, sought permission to re-open the college on its present site after purchasing Esrom House and 20 acres (8.1 ha) of adjoining land.

The nearby Travellers' Rest Hotel was purchased for additional classrooms, and Walmer House on the river was leased for boarders.

[1] Dan Massey resigned at the end of 1983 and Deputy Headmaster Bruce Clydsdale, took over until Robert Bickerdike was appointed in 1985.

Previously Principal of Girton College and Head of Geelong Grammar's Timbertop, Bickerdike was headmaster for eight years, during which buildings were added and student numbers increased.

[1] Doug Finlay left as Master of the Junior School in December 1989 and was succeeded by Jock Bidwell in January 1990.

Miller had received a Rowing Blue at Sydney University and represented Australia in the Senior B Lightweight Four.

The Sydney Morning Herald dedicated its final rugby column of 1999 to the efforts of the All Saints' First XV.