The architecture is a local interpretation of the Japanese Metabolist Movement, and the building was designed by architect Kao Er-Pan.

In 1996 the largest ever Taipei Biennial was held under the title "The Quest for Identity", involving 110 artists and all floors of the building.

In 1986 the first director, Su Rui-ping, had to step down after she had eliminated the installation of artist Zhang Jianfu from an "experimental" exhibition with her own feet, and in 1985 had a red metal sculpture called "Unlimited Minimalism" of Li Zai-qian repainted in silver.

As a form of late justice, in 2006 a red sculpture called "Homerun" was permanently installed on the plaza facing the main entrance.

In 1988 performance artist Lee Ming-Sheng was beaten up by museum guards when he brought a glass of his feces to a public discussion during the "World of Dada" exhibition, which also featured Duchamp's famous urinal.

In 1995 newly appointed director Chang Chen-yu was forced to step down after months of protests of the art scene against his style of leadership and his use of museum funds.

With the turn of the millennium and the growing professionalization of the art scene, this close-quarter relationship between the museum and the local art scene has considerably changed: at the 2004 Taipei Biennial, the statement of the local curator was eliminated from the official catalogue, without creating any major repercussions.