He was a French youth international having played at all levels before switching to represent the Martinique national team.

He attracted interest from French clubs on the mainland after his performances at the annual Coupe Nationale des 14 ans, which was held at the Clairefontaine academy.

The player signed for Saint-Étienne citing the club's history stating, "The ASSE is legendary in Martinique.

"[3] During his early years at the club, former Saint-Étienne striker and fellow Martiniquais Frédéric Piquionne served as a mentor.

[3] During the summer of 2008, he signed his first professional contract agreeing to a three-year deal, which kept him with the Rhône-Alpes-based outfit until 2011.

[20] On 30 January 2013, Rivière joined Monaco on a four-and-a-half-year contract for a fee reported to be around €4 million.

[23] In Monaco's match against Montpellier on 18 August, he scored his first ever career hat-trick as the club eased to a 4–1 victory.

[26] On 16 July 2014, Rivière joined Premier League side Newcastle United, signing a four-year contract for an undisclosed fee believed to be in the region of £6 million.

It was an easy decision because Newcastle is a big club with great fans and a good stadium.

[31] On 31 August 2016, Rivière was loaned to La Liga side CA Osasuna for the 2016–17 season.

On 25 August 2017, Rivière completed a move to French Ligue 1 club FC Metz.