[2] Idrizaj joined the youth setup of local side Flamurtari Vlorë as an 11 year old in 2000, and he progressed through the ranks at the club and played at under-17 and under-19 level, before leaving in 2008 to sign his first professional contract with Bylis Ballsh.
He made his professional debut on 14 September 2008 in a league game against Elbasani, where he came on as a 20th-minute substitute for injured Roland Nenaj in what would be his only appearance in a season that saw Bylis Ballsh get relegated from the Albanian Superliga.
On 24 June 2016, Idrizaj was presented as the new player of Skënderbeu Korçë; he joined on a three-year contract, taking squad number 28.
[4] He opened his scoring account four days later in the returning leg of 2016–17 Albanian Cup first round against Butrinti Sarandë which was won a record 8–0.
[8] On 30 July 2017, Idrizaj completed a transfer to newly promoted top flight side Kamza by penning a contract for the 2017–18 season.