The predominant housing was a mixture of attached and detached two- and three-story buildings with one or multiple units, closely set on small lots.

Later, larger four- to six-story buildings were constructed in addition on some remaining parcels as the demand for housing in the area increased.

Vacant land was used to provide temporary housing, using Quonset hut structures, to returning World War II veterans.

In 2000, the largest remaining collection of vacant parcels was developed near Castle Hill Point with modern two-story, two-unit attached rowhouses.

Like neighboring Soundview, Castle Hill began to fall into rapid decay in the 1970s due to white flight, growing poverty rates, and a citywide fiscal crisis.

Crime has also seen a significant decline versus historic highs as a result of a number of factors including enhanced policing techniques and changing economic demographics.

Based on this calculation, as of 2018[update], Castle Hill and Parkchester are considered low-income relative to the rest of the city and not gentrifying.

The Castle Hill Avenue Business Improvement District was started with the assistance of Councilwoman Annabel Palma and James Vacca in June 2012.

[9] The Shops at Bruckner Commons, which greatly expanded throughout the 1990s and mostly renovated in 2018, divides Castle Hill from neighboring Soundview and contains some national chain stores.

Other primary thoroughfares contain amenities like supermarkets, pharmacies, barbershops, hair salons, fast food, bodegas, and cheap shops.

[4]: 14 The concentration of fine particulate matter, the deadliest type of air pollutant, in Castle Hill and Parkchester is 0.0076 milligrams per cubic metre (7.6×10−9 oz/cu ft), more than the city average.

[16] Castle Hill and Parkchester generally have a similar rate of college-educated residents to the rest of the city as of 2018[update].

[4]: 6  The percentage of Castle Hill and Parkchester students excelling in math rose from 23% in 2000 to 44% in 2011, and reading achievement increased from 27% to 30% during the same time period.

[17] Castle Hill and Parkchester's rate of elementary school student absenteeism is higher than the rest of New York City.

[5]: 24 (PDF p. 55) [4]: 6  Additionally, 69% of high school students in Castle Hill and Parkchester graduate on time, lower than the citywide average of 75%.

The Kips Bay Boys and Girls Club (Lucile Palmaro Clubhouse), located at 1930 Randall Avenue, has an ice skating rink.

Scenes from the 1984 movie The Pope of Greenwich Village, directed by Stuart Rosenberg, were filmed under the Castle Hill stop on the #6 train and on the platform as well.