The school was founded in 1920 by a group of supporters led by Martha Bell Sanders and Mary Hutchens Smith, with Ernest Bloch serving as its first director.

[5] CIM is located in the University Circle, a four-mile square neighborhood on the east side of Cleveland.

Opened in 1961, the main building houses teaching studios, practice rooms, recital halls, a music library, and classrooms.

This included a new entryway and lobby, an expansion to the music library, a new recital hall, recording/broadcast suites, new practice rooms, and additional administrative offices.

[6][7] Through a cooperative arrangement with nearby Case Western Reserve University, CIM students have full access to many university amenities, and, if accepted to both institutions, can pursue a dual degree both at CIM and Case Western Reserve.