The Cathedral of Immaculate Conception is across Eagle Street from the park, while Madison Place, which is only one block-long, consists of rowhouses primarily in High Gothic and Italianate architecture, built in the mid-to-late-19th century.

[2] The park features the oldest fountain in the city which is surrounded by a small circular garden, two circular beds are also in the park and each feature a shrub surrounded flowers, these small gardens make Bleecker Park "a most charming and restrained Victorian public garden" according to an article in the Albany Times Union.

[4] The Cathedral of Immaculate Conception was built across Eagle Street from the park in 1852.

[citation needed] In 1863 the first public fountain in the city was erected in the park, a gift from William Fleming.

[5] In 1986 as part of the 300th anniversary of the Dongan Charter incorporating Albany as a city, the Bleecker Park fence enclosure received a new coat of paint thanks to inmate labor from the Hudson Correctional Facility.