The Greek Revival building (listed on the NRHP as Classical Revival) was designed by Frank Delos Wolfe to replace an earlier two story Victorian-style wooden schoolhouse that burned down in 1912.

[2][3] The structure was built by the architect's brother, Theodore Linfield Wolfe, in 1916 for $13,212, and had offices, at least four classrooms, and an auditorium.

[2][3] During the three years of construction, school was held in a building on a nearby ranch.

The 60,000 square feet (5,600 m2), two-level library is the largest in the Santa Clara County Library system, and places the Milpitas Grammar School building in the center and bookends it with wings to the north and south.

The school's original open courtyard was covered with a tensile fabric roof to filter the sunlight.