Gordon was educated at the local Academy, and later studied at Bonn and Wiesbaden in Germany, before attending engineering lectures at University College, London, and simultaneously serving as a pupil to J. G. C. Curtis.
In October 1871 the Duffy government began fresh negotiations and Gordon moved to Melbourne, arriving on 5 May 1872 to take up the position as chief engineer of the Board of Lands and Works.
One of his major achievements in this period was the construction of Australia's first arch concrete dam in 1873, at Stoney Creek, for the Geelong water supply.
He transferred to the Water Supply Department on 2 February 1875, where he was chief engineer until the infamous Black Wednesday, (9 January 1878), when dozens of public servants were sacked in a government financial crisis.
Debate in Parliament about his dismissal brought out conflicting views, both criticising his work on the Stony Creek weir, and praising his abilities.
He died on 25 February 1907 at his home, Ellerslie in Gordon Street Toorak, aged 78 leaving assets of £8289, including £2603 in property.