The Celts were established in 1910 as a semi-pro team made up primarily of players from Miami University in nearby Oxford.

An early member of the squad, George Roudebush, referred to the team as being run “by a bunch of wild Irishmen.” In 1914, Lou Partlow played for the Celts.

While Pine Village consisted of only 300 residents, it was the top team in Indiana before World War I, compiling a record of 12 undefeated seasons.

The team accepted an invitation the following year, but proved unequal to the task, being outscored 117–14 in their only four league games.

The Celts also faced the 1920 APFA champion Akron Pros, Cleveland Tigers and the Evansville Crimson Giants, losing handily in each contest.