In 1476, King Afonso V of Portugal granted Dom Lopo de Almeida, a descendant of King Pedro I of Portugal through an illegitimate line, the title of Count of Abrantes, which became extinct when Dom Miguel de Almeida, 4th Count of Abrantes and a Restoration hero, died without issue.

Dom José Maria da Piedade de Lencastre e Távora (born 1960) is the 11th and present Marquess of Abrantes.

In 1497, under King Manuel I of Portugal, the building was transformed into a royal residence due to its unique location facing the Tagus river and between the centre of Lisbon and the new area of Belém.

In 1510, Gil Vicente presented some of his plays (in Portuguese: autos) there, and from that location King Sebastian of Portugal left to join the Battle of Alcácer Quibir.

Following the death of the 8th Marquess in 1870, the palace was rented to Count Armand, French Minister in Lisbon, who established legation services there.

Visitors are welcome, depending on availability in accord with the needs of the embassy of France, which usually opens some rooms to public viewing on International Museum Day (18 May).