Born and raised in Lynge, Olsen played for several North Zealand clubs in his youth; Allerød FK, Lyngby Boldklub and Farum BK in two rounds.
Here he never made the breakthrough to divisional football, but managed to make his official debut for the club in a cup match against Vanløse IF in September 2020, where Olsen also got on the scoreboard.
Prior to the 2021–22 season, Olsen switched back to his childhood club, Allerød FK, who played in the Denmark Series Pool 1.
In pursuit of more playing time, on 16 January 2024, Olsen was loaned out to Danish 2nd Division side HIK until the end of the season.
[7] At the end of May 2024, Hvidovre confirmed that Olsen's contract with the club, which was due to expire on 30 June 2024, wouldn't be extended.