Developing A Cognitive Reflection Test for School-Age Children

The cognitive reflection test (CRT; Frederick, 2005) assesses how well adults can reflect on the validity of their own thinking, and it has been shown to predict several measures of normative reasoning. Here, we sought to create a version of the cognitive reflection test suitable for elementary-schoolaged children, which could be used to study the emergence of cognitive reflection as well as its role in the development of other forms of higher-order cognition. We identified eight child-friendly questions that elicit an incorrect, intuitive response that must be inhibited in order to provide a correct, analytic response. We compared children’s and adults’ performance on these questions (dubbed the CRT-D) to several measures of rational thinking (denominator neglect, base rate sensitivity, syllogistic reasoning, otherside thinking) and thinking dispositions (actively open-minded thinking, need for cognition). The CRT-D was a significant predictor of rational thinking and normative thinking dispositions in both children and adults. Moreover, performance on the CRT-D correlated with performance on the original CRT in adults, and in children, it predicted rational thinking and normative thinking dispositions above and beyond age. These results suggest that the CRT-D is a valid measure of children’s cognitive reflection and pave the way for future investigations of its development and its developmental consequences.

[1]  Andrew Shtulman,et al.  Cognitive Reflection Predicts Science Understanding , 2014, CogSci.

[2]  K. Stanovich,et al.  The Cognitive Reflection Test as a predictor of performance on heuristics-and-biases tasks , 2011, Memory & cognition.

[3]  Ilana Ritov,et al.  The role of actively open-minded thinking in information acquisition, accuracy, and calibration , 2013, Judgment and Decision Making.

[4]  Samuel Greiff,et al.  A Need for Cognition Scale for Children and Adolescents: Structural Analysis and Measurement Invariance , 2019, European Journal of Psychological Assessment.

[5]  L. V. Waes,et al.  Development and Testing , 2021 .

[6]  Caterina Primi,et al.  The development and testing of a new version of the cognitive reflection test applying item response theory (irt). , 2016 .

[7]  K. Stanovich,et al.  Rational thinking and cognitive sophistication: development, cognitive abilities, and thinking dispositions. , 2014, Developmental psychology.

[8]  Jonathan J. Rolison,et al.  The time course of conflict on the Cognitive Reflection Test , 2016, Cognition.

[9]  Keith E. Stanovich,et al.  Assessing miserly information processing: An expansion of the Cognitive Reflection Test , 2014 .

[10]  K. Stanovich,et al.  Heuristic and analytic processing: age trends and associations with cognitive ability and cognitive styles. , 2002, Journal of experimental child psychology.

[11]  Daniel M. Oppenheimer,et al.  Investigating an alternate form of the cognitive reflection test , 2016, Judgment and Decision Making.

[12]  Jonathan A. Fugelsang,et al.  Everyday Consequences of Analytic Thinking , 2015 .

[13]  Sydney E. Scott,et al.  Why does the Cognitive Reflection Test (sometimes) predict utilitarian moral judgment (and other things) , 2015 .

[14]  S. Frederick Journal of Economic Perspectives—Volume 19, Number 4—Fall 2005—Pages 25–42 Cognitive Reflection and Decision Making , 2022 .