The early history of the domain was difficult due to the tyrannical rule of the local karō Shirai Tanemori and his son Taneshige.

The third daimyō, Akizuki Tanenobu resolved the problems caused by the Shirai and also worked to restore the domain's worsening finances.

Furthermore, Akizuki Tanenobu constructed a moat and rebuilt the gates and daimyo palace at his castle, changing its name from "Takarabe" to "Takanabe" in 1673.

Takanabe became noted for its high level of education and the large number of samurai who had attended its academy.

The domain played little role in the Meiji restoration and became Takanabe Prefecture in 1871 with the abolition of the han system.