Prior to, and until around 1904, this community was originally known as Centerville since it was almost equidistant from the surrounding towns of: Monroe, Social Circle, Covington, and Loganville,.

But, when the town decided to establish a US Post Office of its own, rather than have to travel to the county seat, or... to collect mail, a problem arose.

At the time, this area was primarily agricultural and was very well known for its high quality in dairy farming and production of high quality milk.. Only a couple of months prior to this event, Old Man H. D. Ambercrombie (a quite prominent businessman, and early settler in that area) had just taken possession of his newly imported—at great expense—full blooded, Jersey Bull from the European Isle of Jersey, acquired to improve the quality of his herd and to increase their milk production.

[6] According to the United States Census Bureau, the town has a total area of 0.8 square miles (2.1 km2), all land.

Up until the early 1960s, the town of Jersey had its own School and virtually all of the teachers were also local area residents who knew each one of the children, and their entire families.