The Rimberg lies in the southern foothills of the Knüllgebirge in the southwest part of the Hersfeld-Rotenburg district between the towns of Alsfeld in the west-southwest and Bad Hersfeld in the east-northeast.
There is also a transmission mast on the Großer Bartküppel about 170 m east of the Motel-Rasthaus Rimberg, on the other side of the federal highway 5.
The high altitudes of the Rimberg are crossed by the quite curvy Hattenbacher triangle – Alsfeld –Ost section of the federal highway 5, the gradients of which are particularly difficult for trucks.
The Rimberg belongs to the main natural unit group East Hessian Mountains (No.
35) in the main unit Fulda-Haune-Tafelland (355) to the Ottrauer Bergland natural area (355.0).