For system 2 to be activated, a person must note that their first answer is incorrect, which requires reflection on their own cognition.
[11][12] Those participants that are familiar with the CRT tend to outscore those with no previous exposure, which raises questions about the validity of the measure in this population.
[11][12] In an effort to combat limitations associated with familiarity, researchers have developed a variety of alternative measures of cognitive reflection.
[13][14][15] Recent research, however, suggests that the CRT is robust to multiple exposure, so that despite the raw score increases in experienced participants, its correlations with other variables remain unaffected.
[16] Another limitation is due to a lack of strong psychometric properties and scarcity of validity studies in the literature.