Today the palace is designated by the Government of Japan as an official accommodation for visiting state dignitaries.

Located in the Moto-Akasaka, Minato, Tokyo, the building took on its present function in 1974, having previously been an imperial detached palace.

Designed by the architect Katayama Tōkuma (片山 東熊), who studied under Josiah Conder at the Imperial College of Engineering, the Neo-Baroque structure was constructed between 1899 and 1909 as a residence for the Crown Prince.

During the renovation of his contemporary residence, Hirohito intended to lodge temporarily at Akasaka Palace, moving in on August 28, 1923.

Several governmental offices were installed in the palace, including the National Diet Library which was founded in 1948,[4] Cabinet Legislation Bureau and Organizing Committee of Tokyo Olympics 1964.

As the post-war occupation of Japan after the Second World War ended and the country went back to the international stage, a State Guest House was needed.

The former residence of Prince Asaka, currently Tokyo Metropolitan Teien Art Museum, was used as the state guest house for a brief period, but it was too small for that purpose.