Middleburg was originally named Swinefordstown (Swinefordstettle in the Pennsylvania Dutch dialect) after John Albright Swineford who ran a tavern here in 1787.

He was also the owner of land located on the north bank of the Middle Creek on which engineer Frederick Evans laid out the town in 1800.

Stump's Run is located to the west of the Glendale Cemetery and is also near the Snyder County Historical Society.

The two men were arrested and taken to the Cumberland County jail at Carlisle for trial, but were freed at the hands of a sympathetic mob.

When the Sunbury and Lewistown Railroad was constructed, more lots for homes were laid out, and the southern section of the town was first known as Franklin, and later, Swineford.

[9] In January 1917, the property owners in Swineford petitioned the Middleburgh borough for annexation, and this wish was granted in February of the same year.

Most of the raw material used at the plant came from South America, and many of the finished products were used in the manufacture of Florsheim Shoes.

[13] According to the United States Census Bureau, the borough has a total area of 0.9 square miles (2.3 km2), all land.

There are three regular regional newspapers: The Snyder County Times (headquartered in borough), The Shopper, and The Daily Item.