Joseph McGhee was born at Coalton, Jackson County, Ohio, where he attended the public schools.

[1] He taught school, and studied law with Judge James Tripp at Jackson, Ohio, and was admitted to the bar at Columbus in 1898.

He held that position until October, 1913, when Hogan appointed him Advisory Counsel to the State Utilities Commission, where he served until January 11, 1915.

[1] Immediately after resigning at the Utilities Commission, McGhee associated with Frank Davis, Jr. and James I. Boulger in law practice at Columbus as McGhee, Davis & Boulger.

He won election for Attorney General in 1916, and was inducted January 8, 1917.