[2][3] During his lifetime, in a similar fashion to other Croatian and European noblemen, he had an anachronistic tendency to trace his family ancestry to Roman patricians.
[3] In 1508, he temporary fought against Maximilian I's army in the hinterland of Venice, when on return he successfully defended Mutnik from Croatian noblemen, and was possibly helped by the Ottoman forces.
[3] In 1519, Stjepan Posedarski, a humanist, chaplain and envoy of Karlović from the Posedarski branch of the Gusić tribe, in the name of Karlović delivered anti-Ottoman speech Oratio Stephani Possedarski habita apud Leonem decimum pontificem maximum pro domino Ioanne Torquato comite Corbauie defensore Crouacie to Pope Leo X.
Upon learning this in Udbina, Karlović assembled his men and went to Plješivica, where they managed to find late ban's severed head and decapitated body.
As he steadily impoverished due to permanent warfare and noblemen did not accept new taxes in order to the increase revenues in 1523, he resigned from the position of Ban in 1524.
The election was part of a succession crisis and civil war as lower nobility in Hungary and Slavonia chose to support John Zápolya.
As Ottomans conquered his forts of Obrovac, Udbina, Komić, and Mrsinj-grad, he received substitute estates of Medvedgrad, Lukavec and Rakovec in Turopolje from Ferdinand I.
[2] In 1528, near Belaj he commanded Croatian army with reinforced by Carniolan forces, which defeated several thousand Ottoman troops preparing to raid Carniola.
Karlović nephews Nikola and Ivan Zrinski in 1541 arranged to carve the inscription on his tombstone, saying "Sepultus genere Spectabilis militiaque praeditus magnificus dominus Torquatus, comes Corbaviae regnorumque Croatiae et Sclavoniae banus mole sub hac tegitur".
In a 16th century Glagolithic document about his seal and coats of arms, described it to depict a goose on a shield, above them letters I. C., meaning Joannes Caroli.
[13] In 1736, Hungarian polymath Samuel Timon described the alleged coat of arms on the tombstone, and according to it, in 1802 Károly Wagner described the color, but they were inspired by 17th-century armorials like Opus Insignium Armorumque (1687–1688) by Johann Weikhard von Valvasor.
[14] In the folk tradition, the fortified towns in ruin like Komić, Kozja Draga, and Mazin are still called as Karlovića dvori ("Karlović's palaces").