In September 1956, the S. Perry Brown family donated funds to build a facility on the Southeast Texas State Fairgrounds.

The donation was contingent upon the City of Beaumont providing professional direction and a dedicated educational focus to the Museum.

In August 2007, AMSET opened a semi-permanent gallery featuring the folk art totems of Beaumont self-taught artist Felix “Fox” Harris.

Harris’ work had an eventful history at the museum – from its installation in outdoor areas, to de-installations due to hurricane threats, to criticism from the community, to many years in storage – the totems finally found a resting place in the newly dedicated gallery inspired by Harris’ home site.

[2][3] AMSET is one of the earliest museums in the United States to collect artwork by contemporary self-taught artists.