He was again in trouble with the authorities due to his Radical affiliation after the assassination attempt against ex-King Milan Obrenović (1889), as well as during the so-called Čebinac affair (1894).
As Minister of Interior, he was criticized for not acting strongly against attacks by a mob on the members of the Progressive party in the streets of Serbian cities in May 1889.
Jointly with another prominent Radical leader, Jovan Đaja, Kosta Taušanović launched the Narod (The People) daily.
In Beogradska zadruga (Belgrade Co-op) he founded the first Serbian insurance society; in Trgovačka zadruga (Merchant Co-op), he redirected their business into export of livestock; at Izvozna banka (Export Bank) he contributed greatly to the company's establishment as a serious enterprise.
His friends and admirers erected a monument of him at the entrance of the Kalemegdan Park (formerly the city fortress) in downtown Belgrade.