Pélissier was born at Maromme (Seine Inférieure), of a family of prosperous artisans, his father being employed in a powder-magazine.

After attending the military college of La Flèche and the special school of St Cyr, he entered the army in 1815 as second-lieutenant in an artillery regiment.

However, the severity of his conduct in suffocating the whole Ouled Riah tribe in the Dahra or Dahna caves, near Mostaganem, where they had taken refuge (18 June 1845), aroused such indignation in Europe that Marshal Soult, the minister of war, publicly expressed his regret; but Marshal Bugeaud, the governor-general of Algeria, not only approved, but secured for Pélissier the rank of général de brigade (Brigadier-General), which he held until 1850, when he was promoted to général de division (Major-General).

His command was marked by relentless pressure of the enemy and unalterable determination to conduct the campaign without interference from Paris.

On his return to Paris he was named senator, created Duke of Malakoff (22 July 1856; the only other victory title awarded by Napoleon III, also ducal, was for the victory by Patrice de MacMahon in the battle of Magenta, in the Italian campaign), and rewarded with a grant of 100,000 francs per annum.