Victor Razafimahatratra was born in Ambanitsilena-Ranomasina, and studied at the Major Seminary of Fianarantsoa before entering the Society of Jesus, more commonly known as the Jesuits, on 19 September 1945.

He was Rector of the Major Seminary and Institute of Superior Studies in Fianarantsoa from 1969 to 1971.

On 16 January 1971 Razafimahatratra was appointed Bishop of Farafangana by Pope Paul VI.

Razafimahatratra was later named President of the Episcopal Conference of Madagascar in 1974, and was promoted to Archbishop of Tananarive on 10 April 1976.

Pope Paul created him Cardinal Priest of S. Croce in Gerusalemme in the consistory of 24 May 1976.