Built in the early 16th century by the Talenti family, the palazzo was soon sold to the rich Flemish merchant Martino D'Anna (van Haanen).

During the 18th century, the building changed hands again, first inherited by the Venetian patricians Foscarinis and later by the Martinengo counts of Brescian origin.

In the 19th century, the palazzo became the property of Count Giovanni Conti who ordered the building to be a retirement home after his death.

The noble floor and the attic are divided by a string course cornice and a wide band of plaster that originally featured frescos by Giovanni Antonio da Pordenone, which has now completely disappeared.

Its frieze contains the names of the victorious battles of the Italian army in Tripolitania during the war in Africa, as a reference of Volpi's governorate there between 1921 and 1925.