Kyme trained for the priesthood at Ridley College, Melbourne and was ordained in 1958.
He was the Incumbent at St Matthew's Church, Ashburton from 1963 to 1969 and Dean of Geraldton from 1969 to 1974.
He was then at Claremont, Western Australia from 1974 and Archdeacon of Stirling, WA from 1977.
From 1993 to 2000 he served as National Director of the Australian Board of Missions.
[5] Bishop Kyme wrote a number of books on history of Anglican church organisations and schools.