However, his popularity quickly dwindled after he began campaigning for the 2020 Taiwanese presidential election, leading to a recall proposal on 26 December 2019.

[8] Han claimed that the recall vote would damage his reputation, interfere with his mayoral duties, burden other city officials, and delay municipal work programs.

[18][19] Kuomintang chairman Johnny Chiang stated that he accepted the outcome of the recall vote, and apologized to city residents for the party's shortcomings.

"[20] Approximately five hundred supporters of Han from around Taiwan gathered in Taipei on 13 June to protest his recall and the policies of the Tsai Ing-wen presidential administration.

[21][22] Former counselor to the Kaohsiung City Government Yang Ming-jou was appointed interim mayor on 13 June by the Secretary-General of the Executive Yuan, Li Meng-yen.