The project consists of: Due to resource constraints, only a small subset of common programming languages are supported, up to the discretion of the game's operator.
This highlights that within the constraints of a given language, a solution can be given which is either of high abstraction, is memory efficient, is fast, or can be parallelized better.
It was a design choice from the start to only include very simple toy problems, each providing a different kind of programming challenge.
[9] The developers themselves highlight the fact that those doing research should exercise caution when using such microbenchmarks: [...] the JavaScript benchmarks are fleetingly small, and behave in ways that are significantly different than the real applications.
At other times, runtime performance was shown to be below expectations, which prompted compiler developers to revise their optimization capabilities.