According to the United States Census Bureau, the town has a total area of 5.7 square miles (15 km2), all land.

As of the 2020 United States Census, there were 241 people, 135 households, and 66 families residing in the town.

The racial makeup of the town was 64.40% African American, 34.66% White, 0.70% Asian, and 0.23% from two or more races.

24.7% of all households were made up of individuals, and 8.9% had someone living alone who was 65 years of age or older.

The town of Cary is served by the South Delta School District.