Checking the “Academic Selection” argument. Chess players outperform non-chess players in cognitive skills related to intelligence: A meta-analysis

Abstract Substantial research in the psychology of expertise has shown that experts in several fields (e.g., science, mathematics) perform better than non-experts on standardized tests of intelligence. This evidence suggests that intelligence plays an important role in the acquisition of expertise. However, a counter argument is that the difference between experts and non-experts is not due to individuals' traits but to academic selection processes. For instance, in science, high scores on standardized tests (e.g., SAT and then GRE) are needed to be admitted to a university program for training. Thus, the “academic selection process” hypothesis is that expert vs. non-expert differences in cognitive ability reflect ability-related differences in access to training opportunities. To test this hypothesis, we focused on a domain in which there are no selection processes based on test scores: chess. This meta-analysis revealed that chess players outperformed non-chess players in intelligence-related skills ( d −  = 0.49). Therefore, this outcome does not corroborate the academic selection process argument, and consequently, supports the idea that access to training alone cannot explain expert performance.

[1]  Wolfgang Viechtbauer,et al.  Conducting Meta-Analyses in R with the metafor Package , 2010 .

[2]  Neil Charness,et al.  Expertise and age effects on knowledge activation in chess. , 2006, Psychology and aging.

[3]  Carol M Woods,et al.  Publication bias in research synthesis: sensitivity analysis using a priori weight functions. , 2005, Psychological methods.

[4]  Feng Li,et al.  An Introduction to Metaanalysis , 2005 .

[5]  M. Peters,et al.  A Redrawn Vandenberg and Kuse Mental Rotations Test - Different Versions and Factors That Affect Performance , 1995, Brain and Cognition.

[6]  A. Jensen,et al.  The g factor , 1996, Nature.

[7]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[8]  D. Lubinski Exceptional Cognitive Ability: The Phenotype , 2009, Behavior genetics.

[9]  S. Frederick Journal of Economic Perspectives—Volume 19, Number 4—Fall 2005—Pages 25–42 Cognitive Reflection and Decision Making , 2022 .

[10]  Hristos Doucouliagos,et al.  Meta‐regression approximations to reduce publication selection bias , 2014, Research synthesis methods.

[11]  M. Frydman,et al.  The general intelligence and spatial abilities of gifted young Belgian chess players. , 1992, British journal of psychology.

[12]  Alex J Sutton,et al.  Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetry. , 2008, Journal of clinical epidemiology.

[13]  F. Gobet,et al.  Visuospatial abilities of chess players. , 2002, British journal of psychology.

[14]  J. Unterrainer,et al.  Revising superior planning performance in chess players: the impact of time restriction and motivation aspects. , 2011, The American journal of psychology.

[15]  B. Milner,et al.  Interhemispheric differences in the localization of psychological processes in man. , 1971, British medical bulletin.

[16]  Lutz Jäncke,et al.  The architecture of the chess player׳s brain , 2014, Neuropsychologia.

[17]  P. Vernon Speed of Information Processing and General Intelligence. , 1983 .

[18]  K. A. Ericsson,et al.  Why expert performance is special and cannot be extrapolated from studies of performance in the general population: A response to criticisms. , 2014 .

[19]  H. Simon,et al.  Skill in Chess , 1988 .

[20]  F. Gobet,et al.  Moves in Mind: The Psychology of Board Games , 2004 .

[21]  W. Schneider,et al.  Chess expertise and memory for chess positions in children and adults. , 1993, Journal of experimental child psychology.

[22]  Frank L. Schmidt,et al.  Increased Accuracy for Range Restriction Corrections: Implications for the Role of Personality and General Mental Ability in Job and Training Performance , 2008 .

[23]  R Morice,et al.  Frontal/executive impairments in schizophrenia. , 1996, Schizophrenia bulletin.

[24]  E. M. Altmann,et al.  Deliberate practice: Is that all it takes to become an expert? , 2014 .

[25]  Fernand Gobet,et al.  The relationship between cognitive ability and chess skill: a comprehensive meta-analysis , 2016 .

[26]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[27]  Jörg Doll,et al.  Intelligenz und Schachleistung—eine Untersuchung an Schachexperten. , 1987 .

[28]  S Duval,et al.  Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis , 2000, Biometrics.

[29]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[30]  J. Hunter,et al.  Validity and Utility of Alternative Predictors of Job Performance , 1984 .

[31]  D. Ozer Personality, intelligence, and spatial visualization: correlates of mental rotations test performance. , 1987, Journal of personality and social psychology.

[32]  Fernand Gobet,et al.  Deliberate Practice , 2011 .

[33]  Michael A. McDaniel,et al.  The Validity of Conscientiousness Is Overestimated in the Prediction of Job Performance , 2015, PloS one.

[34]  Sven Kepes,et al.  Meta-analytic Reviews in the Organizational Sciences: Two Meta-analytic Schools on the Way to MARS (the Meta-analytic Reporting Standards) , 2013 .

[35]  D. Ozer Personality, intelligence, and spatial visualization: correlates of mental rotations test performance , 1987 .

[36]  D. Lubinski,et al.  Beyond the Threshold Hypothesis , 2010 .

[37]  F. Schmidt,et al.  The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. , 1998 .

[38]  Herbert A. Simon,et al.  Five seconds or sixty? Presentation time in expert memory , 2000, Cogn. Sci..

[39]  U. Halsband,et al.  Planning abilities and chess: a comparison of chess and non-chess players on the Tower of London task. , 2006, British journal of psychology.

[40]  Fernand Gobet,et al.  Does chess need intelligence? – A study with young chess players , 2007 .

[41]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[42]  Herbert A. Simon,et al.  Five seconds or sixty? Presentation time in expert memory , 2000 .

[43]  Guillermo Campitelli,et al.  Does the cognitive reflection test measure cognitive reflection? A mathematical modeling approach , 2014, Memory & cognition.

[44]  Huy Le,et al.  Implications of direct and indirect range restriction for meta-analysis methods and findings. , 2006, The Journal of applied psychology.

[45]  A. Ardila,et al.  Correlation between intelligence test scores and executive function measures. , 2000, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[46]  Shu Fai Cheung,et al.  Dependent effect sizes in meta-analysis: incorporating the degree of interdependence. , 2004, The Journal of applied psychology.

[47]  Roland H. Grabner The role of intelligence for performance in the prototypical expertise domain of chess , 2014 .

[48]  Fernand Gobet,et al.  Do the benefits of chess instruction transfer to academic and cognitive skills? A meta-analysis , 2016 .

[49]  Wolfgang Viechtbauer,et al.  Outlier and influence diagnostics for meta‐analysis , 2010, Research synthesis methods.

[50]  A. Orsini Corsi's Block-Tapping Test: Standardization and Concurrent Validity with WISC—R for Children Aged 11 to 16 , 1994, Perceptual and Motor Skills.

[51]  F. Galton Hereditary Genius: An Inquiry into its Laws and Consequences , 1914, Nature.

[52]  A. Elo The rating of chessplayers, past and present , 1978 .

[53]  Ellen M. Kok,et al.  Practice, intelligence, and enjoyment in novice chess players: A prospective study at the earliest stage of a chess career , 2014 .