In 1987, he had his first spell as head coach of Malaysia as he led the team to silver medal of 1987 Southeast Asian Games football competition.
Perlis FA appointed Abdul Rahman in 1996 as head coach, marking his return to the touchline.
Abdul Rahman was appointed in October 1998 to succeed Hatem Souissi as the head coach of Malaysia, after the dismal performance in the 1998 Tiger Cup.
Abdul Rahamn returned to coaching in 2004, taking the helm of club side Kelantan TNB FC.
Abdul Rahman signed for Liga Indonesia club, Deltras Sidoarjo in early 2008.