The original inhabitants were the freed slaves of Virginia Hill, the daughter of a wealthy North Carolina planter.

[3] After purchasing 2,000 acres (8 km2) of isolated hilly land, Hill freed her slaves and turned the property over to them.

Folklore suggests that the original residents included Virginia Hill's own mulatto children.

[4] At its peak, the community had about 300 residents and included two grocery stores, three clubs, two eating establishments, two churches, and a school.

[2] A small number of residents remain in Free Hill, whose population has declined since the 1960s.