[1] The longtime lead singer of the indie rock band Hey Rosetta!,[2] his first solo album Forever Overhead was released on April 19, 2019, on Arts & Crafts.

[4] Following his graduation, he returned to St. John's, where he began performing locally as a solo artist before deciding that his songs needed a fuller band sound and forming Hey Rosetta!

[4] In 2016, Baker debuted his first solo song, "Spirit", on the CBC Radio news program The Current as part of a special series on the economic challenges of life in Newfoundland.

[12] In the same year he recorded a cover of "Leaving on the Evening Tide" for the Ron Hynes tribute album Sonny Don't Go Away.

[13] His third solo album, a collection of original Christmas-themed music titled Full Rainbow of Light, was released on November 15, 2024.