Born in Overton, Hampshire, United Kingdom, the son of David Williams and Sarah Eliza, Williams graduated from Pembroke College, Oxford in 1851.

He was ordained deacon in 1852 and received his ordination as a priest in 1855.

His son, Lennox, was later sixth Bishop of Quebec.

He participated vigorously in the development of the Protestant public school system in Québec and collaborated with Sir Alexander Galt in drawing up Section 93 of the British North American Act (Constitution Act, 1867) which conferred upon Parliament the responsibility of protecting the educational rights of minorities.

This article about a Church of England bishop is a stub.