[7] The approximate coordinates for the Town of Lee is located in eastern Madison County at 30°25′10″N 83°17′59″W / 30.419355°N 83.299631°W / 30.419355; -83.299631.

Interstate 10 passes 3 miles (5 km) south of the town center, with access from Exit 262 (County Road 255).

According to the United States Census Bureau, the town has a total area of 2.4 square miles (6.2 km2), all land.

[5] The climate in this area is characterized by hot, humid summers and generally mild winters.

As of the 2020 United States census, there were 375 people, 212 households, and 122 families residing in the town.

[13] As of the 2010 United States census, there were 352 people, 176 households, and 156 families residing in the town.