Archaeological investigations have indicated the presence at one time of eighteen longhouses of various sizes within the village, with an estimated population of 800-900 people.

The archaeological interpretation concludes that Southwold was a typical pre-contact Neutral village, palisaded for defensive purposes.

The site consists of an oval ring of earthworks enclosing archaeological remains of a double palisade and village, which may have included up to 24 longhouses.

Oral tradition within the local Oneida community recounts that Southwold was used as a ceremonial site, which was enclosed by the palisade so that activities taking place within the village were screened from the view of people outside the wall.

Archaeologists found the site atypical of Neutral villages of the period: it is located on flat land with no natural defensive advantages and, despite the presence of apparent fortifications, it contains no evidence of ever having been attacked.