When Emperor Xiaozhao heard this, he had the official Zhao Daode (趙道德) go to Ding Province to cane Gao Yanzong 100 times.
As Gao Yanzong did not take the punishment with good attitude, Zhao added 30 times to his caning.
Gao Yanzong was also known for testing the sharpness of his sword by cutting humans with it, and for tolerating his staff of abuses.
In 566, when Emperor Wucheng tortured his brother Gao Xiaowan (高孝琬) the Prince of Hejian to death, Gao Yanzong mourned greatly, and he made an effigy of Emperor Wucheng out of straw and whipped it, stating, "Why kill my brother?"
However, shortly after battle began, Gao Wei's favorite consort, Feng Xiaolian and the official Mu Tipo panicked and persuaded Gao Wei to flee, causing the Northern Qi army to collapse.
(Once Gao Wei left Jinyang, however, he changed his mind and fled back to the capital Yecheng instead.)
Meanwhile, the generals at Jinyang all encouraged Gao Yanzong to take imperial title, stating to him that if he did not, they could not fight and die for him.
It was said that Gao Yanzong visited the soldiers and shook their hands, referring to himself by name, to raise the morale.
Gao Yanzong, despite his obesity, personally fought in the battle, and while he had some personal successes, the generals that he left in charge of the east gate, He Aganzi (和阿干子) and Duan Chang (段暢), surrendered to Northern Zhou, allowing Emperor Wu to enter the city—but once Emperor Wu did, Gao Yanzong followed and launched a fierce attack, leading to a general rout of Northern Zhou troops.
Gao Yanzong thought that Emperor Wu must be dead and searched the bodies for him, but could not find him.
Gao Yanzong initially declined, stating, "How can a dead man's hand touch that of the supreme ruler?"
He had Gao Yanzong change into civilian official uniform and treated him with respect, asking him for his input on how Yecheng could be captured.