During World War I Spencer served in the United States Navy as a Seaman, Second Class.

He served until January 3, 1943, and did not stand for election, preferring instead to return to the Navy for World War II service.

He served as director of the Arkansas-Louisiana Gas Company at Shreveport, Louisiana and commissioner of the Southwest Arkansas Water District.

He served as the Arkansas executive vice president of the Red River Valley Association as well.

Spencer also served as the chairman of board and president of First National Bank of Hope, Arkansas.