The city is the site of the coldest recorded temperature in Georgia, −17 °F (−27 °C) on January 27, 1940.

[citation needed] According to a popular legend, the town received its name after a road sign with the word "Chatsworth" fell off a passing freight train nearby.

Chatsworth is located in central Murray County at 34°46′20″N 84°46′44″W / 34.77222°N 84.77889°W / 34.77222; -84.77889 (34.772336, -84.778977),[9] in northwestern Georgia.

Georgia State Routes 2 and 52 run together out of Chatsworth to the east, climbing into the Cohutta Mountains and passing through Fort Mountain State Park 7 miles (11 km) east of the city center.

As of the 2020 United States census, there were 4,874 people, 1,670 households, and 1,117 families residing in the city.