[1] He graduated from Auburn in 1954 with a bachelor of science in agriculture and was commissioned an ensign in the United States Navy[1] He served from 1954 to 1956.

Smith served only one term before being defeated by Democratic Jefferson County commissioner Ben Erdreich.

In 1984, Smith unsuccessfully ran for the United States Senate against incumbent Democrat Howell Heflin.

With his wife Eunie, Smith had three children Karen, Albert Lee III, and Meg and six grandchildren Jackson, Reece, Cooper, Caroline, Ella Kate, and Audrey.

In 2016, following the death of Phyllis Schlafly, his widow Eunie Smith became President of the conservative campaign group Eagle Forum.