Originating from the Republic of Genoa it was previously named Tartaro (10th century), and descends from the House of Ventimiglia.

Also following the behavior of Captain Davide Imperiale during the Battle of Lepanto (7 October 1571), the family acquired much prestige in the Republic of Genoa and had among its members 4 doges.

It was one of the most powerful families dominating the city's politics in the 17th and 18th century and owned a vast amount of land in Italy.

Major works were carried out by the Caracciolo family in the 17th century and by Prince Placido Imperiale after purchasing the building.

Due to the 1980 earthquake, the building underwent a major restoration project, subsequently becoming the property of the Municipality of Salza Irpina.