[14] The opening of St. George's Church, located on Rutherford Place and 16th Street (built on land obtained from Peter Stuyvesant, 1848–1856; burnt down in 1865;[11] remodeled by C.O.Blesch and L. Eidlitz, 1897)[9][15] and the Friends Meeting House and Seminary (to the southwest) (1861, Charles Bunting) attracted more residents to the area around the park.

The earliest existing houses in the district, in the Greek Revival style, date to 1842–43, when the city's residential development was first moving north of 14th Street, but the major growth in the area occurred in the 1850s.

[1] Fashionable houses were still being built as late as 1883, when Richard Morris Hunt's Sidney Webster House at 245 East 17th Street – now the East End Temple synagogue[16] – was completed,[1] but already German and Irish immigrants, had begun moving into new rowhouses and brownstones in the neighborhood, followed by Jewish, Italian and Slavic immigrants.

[17] Because of the number of hospitals in the district, there were many doctor's offices on the side streets, along with quacks and midwives who preyed upon the area's immigrant population.

The park reopened in 1937; the 1980s saw restorations of the two 1884 fountains, the preservation of the cast-iron fence, and relaying the original bluestone sidewalks in two ellipses, with renovated lawns, shrubs and flower beds.

Further contributions to the park have included Gertrude Vanderbilt Whitney's Peter Stuyvesant (1941) and Ivan Mestorvic's Antonín Dvořák (1963, moved here 1997).

Directly around the square, in the eponymous neighborhood, are the Friends Meeting House and Seminary and St. George's Episcopal Church – once attended by J.P. Morgan – both on Rutherford Place.

On the eastern side is Beth Israel Medical Center – part of which, the Robert Mapplethorpe Residential Treatment Facility for AIDS patients, was built on the site of Bohemian composer Antonín Dvořák's 1893 home at 327 East 17th Street.