Around 1900, Tokyo had five public cemeteries - Aoyama, Somei [jp], Yanaka, Zoshigaya and Kameido.

In 1919, city park manager Kiyoshi Inoshita issued a plan to establish a large park/cemetery to the north, east and west of Tokyo.

Tama, to the west of Tokyo, was selected in 1920, with construction started two years later.

The planned northern and eastern cemeteries are Sodaira and Yahashira, respectively.

During World War II, Kawasaki Ki-61 from nearby Chofu Airfield were hidden and repaired in the cemetery.