He made his fortune in oil and ran for the Louisiana State Senate at the request of Huey Long.

He was chosen as president pro tempore of the senate and succeeded to the governorship to finish out Allen's term, since the lieutenant governor had been elected to the state Supreme Court.

Noe ran unsuccessfully for governor in 1940 and 1959 but had more success in his business ventures.

Noe died in Houston, Texas, on October 18, 1976, from complications from a heart condition.

His son, James A. Noe Jr., succeeded him in running the family-owned radio and television stations.