He also carried out reforms within the Belgian Armed Forces with a considerable reduction in the number of soldiers, weapons, and barracks and froze the military budget for five years.
He was a founding member of the Eurocorps and increasingly deployed the Belgian Armed Forces for operations in Yugoslavia, Somalia, and Rwanda.
Delcroix was considered to be on the right side of the CVP and repeatedly questioned the cordon sanitaire within the Vlaams Blok.
After the insistence of CVP party leader Johan Van Hecke, he resigned from his role as Minister of Defense.
However, he was found guilty by a tribunal of first instance in 2003 of forgery of documents [nl] for his role in the Milieubox affair.
In 2013, Delcroix was again accused of misconduct in relation to the Belgian delegation at Expo 2010 in Shanghai, for which he was questioned by the Court of Audit.