Faye began his career playing for ASEC Ndiambour and Jeanne d'Arc in his native Senegal before moving to French side Lens in 2002.
After spending time out on loan at Istres he attracted the attentions of Sam Allardyce who signed him for Bolton Wanderers in July 2005.
Faye was born in Dakar, Senegal and began his career at ASEC Ndiambour, before leaving the then top-three team to go to Jeanne d'Arc.
He then went on to join Lens in July 2002, integrating into a squad which at that time included fellow Senegalese Papa Bouba Diop.
In the 2006–07 season Faye operated almost exclusively as a central defender following the departures of Bruno Ngotty and Jaïdi to Birmingham City.
Over the course of the season he developed a formidable partnership with Ivorian Abdoulaye Méïté, ensuring that Bolton had a strong home defensive record before the new year.
Soon after they fell away in the second half of the season only just qualifying for the UEFA Cup with sides finding a way through Faye and Meite's dominance.
On 15 August 2007, there were stories in several newspapers stating that Faye would be moving to Newcastle United for around £2m to join up with former Manager Sam Allardyce.
[12] On 15 August 2008, Faye joined newly promoted Premier League side Stoke City from Newcastle United for £2.25 million on a three-year contract.
[23] At the end of the season Faye left West Ham after helping them to gain an instant return to the Premier League.
[30] He played 33 times for Hull in 2012–13 helping the Tigers gain promotion to the Premier League on the final day of the season.