Carlton is a city in Madison County, Georgia, United States.

[2] An early variant name of Carlton was "Berkeley", to avoid confusion with Carrollton, Georgia.

Watson Mill Bridge State Park, on the South Fork, is 2.5 miles (4.0 km) southwest of Carlton.

The racial makeup of the city was 74.25% White, 22.75% African American, 1.72% Asian, and 1.29% from two or more races.

About 14.3% of families and 19.6% of the population were below the poverty line, including 29.2% of those under the age of eighteen and 26.8% of those 65 or over.