[2] His first job was in his father's plant, then called Oliver, Bissel and Company, for 75 cents a day.

His public works include funding (along with his father) the Oliver Opera House in 1884, Oliver Hotel in 1899, and City Hall, as well serving as the Indiana Director of War Savings during World War I.

[4] Oliver married Anna Gertrude Wells of Johnstown, New York, on December 10, 1884.

They had four children, James II, Gertrude, Joseph Jr. and Susan Catherine.

[4] The Oliver family built a house on West Washington Street in South Bend.