In early life the revival of Gothic style and ornament led him to make a study of ecclesiastical art, visiting cathedrals in northern Europe.
[2] His latter years were occupied with an energetic attempt to improve the art of painted glass by superintending the processes of execution as well as the design, for which he set up a small workshop.
From this workshop he produced the windows in the ante-chapel of King's College, Cambridge, those in the chancel of St Mary the Virgin's Church, Aylesbury, and several in Ely Cathedral.
The choristers' window at Ely was the joint work of Oliphant and William Dyce, the former being responsible for the original design.
at Oxford and issued in 1891 "Notes of a Pilgrimage to Jerusalem and the Holy Land", which originally appeared as letters addressed to The Spectator.