Charlier was born in Ixelles, the eldest son of a large family.
In 1880, Henri Van Cutsem, an art collector and patron of artists, bought his first works.
Charlier spent some months in Italy where he came into contact with ancient art.
In 1904 Henri Van Cutsem, his patron, died and bequeathed him the house in the Avenue des Arts in Saint-Josse-ten-Noode where he had been living and working.
When Charlier himself died in 1925 his will left the house to the Commune of Saint-Josse-ten-Noode on condition that it should be opened to the public as a museum, as it was in 1928.