It is split between the cities of Fuchu and Koganei within the Tokyo Metropolis.

Around 1900, Tokyo had five public cemeteries - Aoyama, Somei [jp], Yanaka, Zoshigaya and Kameido.

In 1919, city park manager Kiyoshi Inoshita issued a plan to establish a large park/cemetery to the north, east and west of Tokyo.

Tama, to the west of Tokyo, was selected in 1920, with construction started two years later.

During World War II, Kawasaki Ki-61 from nearby Chofu Airfield were hidden and repaired in the cemetery.