The oldest building on the square is at 412–414 East Taylor Street, which dates to 1855.

[3] A notable building facing the western side of the square is the First Congregational Church.

[2] The square, and its immediate vicinity, was once a burial ground for both negro slaves and free persons of all colors.

The original 1805 burial ground included the northern end of today's square, a half block to the north and one block to the west, It was extended in 1812 to the northwest and in 1818 to the south, this time incorporating the southern end of today's square.

George Whitefield (whose last name is pronounced Whitfield),[2] founder of Bethesda Home for Boys (now known as Bethesda Academy) in the 18th century, and still in existence on the south side of the city.