After playing in his homeland, Ranđelović moved to Russia and signed with Anzhi Makhachkala in 1999.
After two years there, Ranđelović went on to play for CSKA Moscow and Zenit Saint Petersburg.
In the 2011 winter transfer window, Ranđelović moved to Mogren, helping them win the national championship that season.
In the 2012 winter transfer window, Ranđelović returned to his country and joined SuperLiga club Sloboda Užice.
In March 2016, Ranđelović briefly served as caretaker manager of Rudar Pljevlja, together with Vuko Bogavac.