His younger brother Mori Tadamasa served Tokugawa Ieyasu and was awarded with Matsushiro Castle in Shinano Province after the Battle of Sekigahara in 1600.

In 1604, after the death of Kobayakawa Hideaki, Mori Tadamada was transferred to Mimasaka Province and awarded a new domain with a kokudaka of 186,000 koku centered on Tsuyama.

The following year, the domain was revived as a 100,000 koku holding for a cadet branch of the Echizen-Matsudaira clan which descended from Yūki Hideyasu, Tokugawa Ieyasu's second son.

The castle was kept in good repair through the Edo era, although the Honmaru Place was lost to a fire in 1809.

[2] After the Meiji restoration, all buildings except one gate (which was moved to neighboring Nakayama Shrine) were demolished in 1873 and the site of the castle became Kakuzan Park (鶴山公園, 'Kakuzan Kōen).

In 1900 the castle site became property of Tsuyama municipality and over 5000 sakura trees were planted and in 1905 the Han school Shudokan (修道館) was relocated to Sannomaru and renamed Kakuzankan (鶴山館).

A regional Industrial Promotion Exposition was held in 1936 during which time a faux tenshu was reconstructed, but it was demolished in 1945 to prevent its use as a landmark by enemy air raids.

To celebrate the castle's 400-year anniversary in 2004, the Bitchū yagura was reconstructed, and the Taiko fence was repaired in 2006.

[3] Every year from April 1st to 15th, the Tsuyama Cherry Blossom Festival is held around the castle ruins park.

Mori Tadamasa had two servants, Ido Uemon (井戸宇右衛門) and Nagoya Kyuemon (名護屋九右衛門).

After Tsuyama Castle was completed, Hosokawa Tadaoki sent a bell imported from Southeast Asia to Mori Tadamasa.

Officials were dispatched by the Tokugawa shogunate to inspect castles, and towers which violated the edict would be demolished.

In an attempt to circumvent the ban, Mori Tadamasa removed the roof of the fourth floor.