[1][2] The original garden dates to the Ming dynasty and was the site of painter Wen Boren's home.

The garden takes its name from five rock peaks which are found on the grounds.

Wen Boren built his home in the garden, and after he moved, a bureaucrat named Yang Cheng purchased the property.

In 2002, Jiangsu province listed the garden as a cultural relic protection unit.

The rockery of the garden was all built of Taihu stones, and it was carefully separated by Wen Boren.