In 1895, the Qing dynasty ceded Taiwan to Japan in the Treaty of Shimonoseki after losing the First Sino-Japanese War, and Siaogang was used to produce sugar for Japanese.

In 1920, the original name of Kang-a-ki (Chinese: 港仔墘; Pe̍h-ōe-jī: Káng-á-kîⁿ) was changed, and the incorporated areas were administered as Kominato Village (小港庄) under Hōzan District, Takao Prefecture.

As a heavy industry base in Taiwan during World War II, Siaogang was more heavily bombed by the Allied force than other parts of the city.

The district consists of Xiaogang, Gangkou, Gangzheng, Gangqi, Gangming, Ganghou, Gangnan, Gangxing, Fenggong, Dianzhen, Daling, Erling, Sanling, Zhengling, Shunling, Liuling, Hongliang, Shantung, Jingdao, Jinan, Taishan, Shanming, Gaosong, Songjin, Songshan, Daping, Pingding, Kongzhai, Xiazhuang, Gezuo, Guilin, Zhongcuo, Fengming, Longfeng, Fengsen, Fenglin, Fengxing and Fengyuan Village.

CPC Corporation, Taiwan also a part of the ten projects, has a major oil refinery facility located here.