Opinion polls following his resignation suggested that Raffarin was one of France's least popular prime ministers since the Fifth Republic was established in 1958.

However, according to the book France: 1815–2003, written by Martin Evans and Emmanuel Godin, Raffarin was "a remarkably popular Prime Minister" despite his ability "to state the obvious and to make empty statements".

Defining himself as a "giscardien", he joined the staff of Lionel Stoléru, Secretary of state for Manual Workers and Immigration, and the Republican Party, the liberal-conservative component of the centre-right confederation the Union for French Democracy (UDF).

In return, he was nominated Minister of Small and Medium-sized Companies, Commerce and Craft Industry in Alain Juppé's cabinet (1995–1997).

Furthermore, elected in a special second round by a majority of left-wing voters, he searched for a moderate to lead the cabinet and the June 2002 legislative campaign.

On 28 March 2004 the ruling UMP party suffered an important defeat during the regional elections, with all but one région out of 22 of mainland France going to the opposition (PS, PCF, Les Verts).

This major cabinet reshuffle removed some of its most controversial ministers like Luc Ferry (education) or Jean-François Mattei (health).

Raffarin's resignation was accepted by President Chirac on 30 May 2005, after the "no" victory at the European Constitution referendum, and he was replaced as prime minister by Dominique de Villepin.

However, mazarinade refers to the songs that the frondeurs (French revolutionaries during the Régence of Queen Anne – Archduchess of Austria – and chief minister Cardinal de Mazarin, before king Louis XIV's personal reign) sang to mock the unpopular chief minister.

The referendum itself was eventually nicknamed le Raffarindum by its opponents while Journée de solidarité envers les personnes âgées (Day of solidarity with the elderly) is sometimes referred to as la Saint-Raffarin by discontented workers (following a decision by Raffarin, French workers are supposed to work on Whit Monday for free, but public transportation still uses its "Sundays and holidays" timetable).