[7] In 2017, Statcheck's developers published a preprint paper concluding that the program accurately identified statistical errors over 95% of the time.
Overall, Statcheck's accuracy was 95.9%, half a percentage point higher than the chance level of 95.4% expected when all tests are simply taken at face value.
[10] More recent research has used Statcheck on papers published in Canadian psychology journals, finding similar rates of statistical reporting errors as the original authors based on a 30-year sample of such articles.
The same study also found many typographical errors in online versions of relatively old papers, and that correcting for these reduced the estimated percent of tests that were erroneously reported.
[18] They also told Vox that they intended to use Statcheck to perform a function similar to a spell checker software program.
These flaggings, and their posting on a public forum, proved controversial, prompting the German Psychological Society to issue a statement condemning this use of Statcheck.