Rahman was commissioned from Bangladesh Military Academy on 21 December 1990 with 23rd BMA Long Course.

During his military career he served as senior instructor and faculty member of Defence Services Command and Staff College and also as directing staff and faculty member of Armed Force War College under National Defence College.

As brigadier general he served as commandant of Army Security Unit at Dhaka, commander of 203rd Infantry Brigade at Khagrachhari and 97th Infantry Brigade at Bandarban.

During his tenure as GOC, he arranged and conducted the exercise on Swarna Dwip in Noakhali name "Joint Manoeuvre Exercise-2022".

Rahman was also the chairman of Bangladesh Army University of Science and Technology at Saidpur.