Born to an ex-samurai family of Sasayama Domain in Hyōgo Prefecture, Andō graduated from the eleventh class of the Imperial Japanese Army Academy in 1899.

Although Andō went into the reserves in 1934, and quickly retired, he was recalled to active duty in 1937 with the start of the Second Sino-Japanese War and was assigned command of the 9th Depot Division.

One of his tasks, assigned personally by Emperor Hirohito was to coordinate efforts to suppress news of the Japanese defeat at the Battle of Midway.

During his tenure as Home Minister, he was successful in curbing the leadership of the Yokusan Sonendan, which had become politicized, and which had become increasing critical of older politicians and bureaucrats and was starting to evolve into a populist political movement independent of the Taisei Yokusankai.

He was held in Sugamo Prison until December 1948, but was never brought to trial before the International Military Tribunal for the Far East.