Dillard is a town in Rabun County, Georgia, United States.

Both James and John were residents of Buncombe County, North Carolina prior to their settlement on lands now comprising Dillard.

The small town is now known primarily for the Dillard House, a regionally well-known inn, restaurant and conference center that serves traditional southern fare.

[5] According to the United States Census Bureau, Dillard has a total area of 1.5 square miles (3.9 km2), all land.

The city is located in the Little Tennessee River valley, immediately south of the North Carolina border and is surrounded by the Blue Ridge Mountains.