Materials may sublimate in vacuum (this includes some metals and their alloys, most notably cadmium and zinc).
The gases liberated from the materials not only lower the vacuum quality, but also can be reabsorbed on other surfaces, creating deposits and contaminating the chamber.
In addition to the gas-related issues, the materials have to maintain adequate strength through the entire required temperature range (sometimes reaching cryogenic temperatures), maintain their properties (elasticity, plasticity, electrical and thermal conductivity or lack of it, etc.
[2] Some outgassed materials can deposit on other surfaces, contaminate the vacuum system and be difficult to get rid of.
Another concern, for orbits closer to Earth, is the presence of atomic oxygen, leading to corrosion of exposed surfaces; aluminium is an especially sensitive material[citation needed].