The college was built on the banks of the Delaware River, 2 miles (3.2 km) from Bristol, Pennsylvania.

The White Hall of the college, built by Alexander Jackson Davis in Greek Revival style, is on the National Register of Historic Places.

Bristol College was used as a hospital during the American Civil War, and from 1868 through the 1880s as an orphanage for the children of colored soldiers.

[2] The center columned section of the last remaining building, White Hall was condemned and later demolished in the 1980s.

The Pennsylvania Literary, Scientific, and Military Academy was established on the former Bristol College building and grounds on September 5, 1842, by Captain Alden Partridge, and was conducted by him until April 1845, when it was discontinued and reopened at Harrisburg, on April 14, of the same year.