Upon graduation, Harris returned to his native Cartersville, Georgia to join his father Frank and brother Fred in the family run cement business.

Since the death of Jimmy Carter on December 29, 2024, Joe Frank Harris is the earliest serving and oldest living governor of Georgia.

When he ran for governor in 1982, Harris was seen as a long-shot candidate, but with the support of the Speaker of the Georgia House Tom Murphy, he was able to win the primary over U.S. Representative Bo Ginn.

Also during his term, Harris created the Growth Strategies Commission chaired by Cartersville native and prominent developer Joel Cowan.

), and the main entrance to the Georgia State Fairgrounds in Perry (Governor Joe Frank and Mrs. Elizabeth Harris Blvd.