Rahimić spent the majority of his career playing for Russian Premier League club CSKA Moscow.

The greatest accomplishment for Rahimić was winning the 2004–05 UEFA Cup by beating Sporting Lisbon 3–1 in the final at Estádio José Alvalade.

Rahimić is one of the most decorated Bosnian players, having won 18 trophies with CSKA Moscow during his 12-year spell with the club.

[1] In January 2013, Rahimić passed the category A coaching license exam, and was appointed as a player-coach at CSKA.

He also played in the 2010 FIFA World Cup qualification where the country reached the play-off stage of the competition, as well as in the UEFA Euro 2012 qualifying.