When Mulhouse were relegated, he joined Cannes on loan in 1998, where he had little success in the league, making 29 appearances and scoring four goals.

At the end of that season he added a Scottish Cup medal to his tally after Celtic beat Dundee United 1–0 in the final.

[15] In the first competitive game, Celtic lost 5–0 to Artmedia Bratislava in the first leg of a Champions League qualifier, with Baldé getting booked.

Baldé kept his place in the side and scored a header from a Shunsuke Nakamura cross in Celtic's 3–0 win over Rangers in November 2005.

Baldé missed the start of the 2006–07 season after discovering he required surgery for a persistent stomach muscle problem.

"I love the club, I am very settled in Glasgow with my girlfriend and I would be happy to fulfil my current contract", said Baldé.

The manager and Peter (Lawwell, Chief Executive) told me this"[18] Baldé was now completely out of contention for a first team place and only made his first start of the 2007–08 season on 26 December 2007, exactly a year after his last appearance, in a 2–0 away win to Dundee United.

Baldé dropped out of the first team again after that, then got injured in early when playing for Guinea at the Africa Cup of Nations.

Baldé was on the bench against Rangers on 29 March 2008, the first time since Christmas he had been selected after recovering from the injury he sustained at the Africa Cup of Nations.

He then started a few days later replacing the suspended Gary Caldwell to make his first appearance since December 2007, with a man of the match performance in the 1–0 win over Aberdeen in the SPL, Georgios Samaras scored the only goal of the game.

[20] At the start of the 2008–09 season, it was announced that Baldé would be allowed to leave Celtic on a free transfer, provided that he could find a club that would meet his salary demands.

He made his first full appearance in Celtic's second Algarve Challenge Cup match against Cardiff City, which was the first meeting of the two teams in 81 years.

[29] On 11 January 2011, it was announced that the remainder of Baldé's contract with Valenciennes was to be cancelled to allow him to join Arles-Avignon, playing in Ligue 2.

His first job off the pitch started in April 2013, where Baldé was hired as a sports coordinator for the national team of Guinea.

[31] In July 2014, Baldé returned to football, signing with his former youth club Gombertois as a playing assistant manager.