He was from a long line of sculptors, painters, and architects that began with his great grandfather, Jean Baillairgé.

He was involved in designing many projects that were under the supervision of his brother, Frédéric, who held a senior position with public works.

The Bon-Pasteur Chapel (1868), a rectangular five-storey stone-faced chapel with a gable roof is part of the motherhouse of the Sisters of the Good Shepherd in Quebec City, designed by Charles Baillairgé, was designated a National Historic Site in 1975 as an outstanding example of religious architecture in Quebec.

[6] Charles Philippe Ferdinand Baillairgé designed a Roman Catholic church and sacristy, 1849 in Beauport, Quebec.

With Joseph F. Peachy, Baillairgé designed the interiors for a Roman Catholic church, Ile d'Orleans, 1863 in St. Laurent, Quebec.