Xu Garden is named for Xu Baoshan [zh] (t 徐寶山, s 徐宝山, Xú Bǎoshān; 1866 – 24 May 1913),[2] a warlord of the late Qing and early Republican eras, who was often based in Yangzhou.

[2] Designed by Yang Bingyan, the garden was established by locals in appreciation of Xu's protection and patronage.

[4][5] These include the Hall of Listening to Orioles (t 聽鸝館, s 听鹂馆, Tīnglí Guǎn), named for the singing venue in the Old Summer Palace, itself named for various Tang poems by Du Fu.

[2] The nearby pond is large by the standards of classical Chinese gardens.

Xu Garden is also the location of the vantage point for Four Bridges in Misty Rain (t 四橋煙雨樓, s 四桥烟雨楼, Sìqiáo Yānyǔ Lóu), one of the 24 views of Yangzhou under the Qing.