He then served Francis II, Duke of Brittany, who in 1480 sent him as ambassador to pope Sixtus IV.
After being freed he became bailiff of Forez, then successfully took part in the negotiations which led to Charles VIII's marriage to duchess Anne of Brittany.
After her death in 1493, he married Antoinette de Beauvau († 1539) on 4 October 1495 - they had one child, the future diplomat and soldier Claude d'Urfé.
After Charles VIII's death and Louis XII's accession and marriage to Anne of Brittany, he had to go into exile for unknown reasons.
He joined the court of Ferdinand II of Aragon but pope Alexander VI's intervention allowed him to be pardoned by the French king in 1503 and return to France.