He began training as a solicitor but was then indentured in his grandfather's house-painting business, and was encouraged to study at the Trustees' Academy at the end of his apprenticeship.
The Lauders returned to Scotland in 1838 but Fraser settled for a time in Paris, painting views of the city.
Together they remodelled Hospitalfield House; the scheme used mainly local craftsmen and converted an eighteenth-century barn into a gallery, added a five-storey bartizan and a large wing.
After his wife's death in 1873, he built a mausoleum in her name, the Fraser Mortuary Chapel in Western Cemetery, Arbroath.
He put great stress on building economically and morally, notions that were expounded in his 1861 work An Unpopular View of Our Times.