The grounds covered 104,402 square meters, and it was located facing Suruga Bay adjacent to the Senbon-Matsubara, a scenic pine grove.

In the neighborhood were the villas of a number of important political figures of the times, including that of Oyama Iwao, Saigō Jūdō and Ōki Takatō.

The east annex was originally a building of the Akasaka Palace estate in Tokyo used by the high steward to the crown prince.

The west annex was originally a villa belonging to count Kawamura Sumiyoshi.

Media related to Numazu Goyotei Memorial Park at Wikimedia Commons