He left school at the age of 13 to work as an agricultural labourer, and emigrated to Western Australia after World War I with an older brother.
Oliver initially settled in Meekatharra, where he worked as a miner, and later also lived in Koolanooka, Perenjori, and Big Bell.
His chief opponent was the Liberal Party candidate, Billy Snedden, who was a future federal Leader of the Opposition.
[2] Oliver remained AWU state secretary until 1978, helping to improve the union's finances and membership numbers.
Oliver also served as ALP state vice-president during the 1955 party split, and was credited with helping to reduce its impact.