Exploratory Factor Analyses of the Intelligence and Development Scales–2: Implications for Theory and Practice

The factor structure of the intelligence and scholastic skills domains of the Intelligence and Development Scales–2 was examined using exploratory factor analyses with the standardization and validation sample (N = 2,030, aged 5 to 20 years). Results partly supported the seven proposed intelligence group factors. However, the theoretical factors Visual Processing and Abstract Reasoning as well as Verbal Reasoning and Long-Term Memory collapsed, resulting in a five-factor structure for intelligence. Adding the three scholastic skills subtests resulted in an additional factor Reading/Writing and in Logical–Mathematical Reasoning showing a loading on abstract Visual Reasoning and the highest general factor loading. A data-driven separation of intelligence and scholastic skills is not evident. Omega reliability estimates based on Schmid–Leiman transformations revealed a strong general factor that accounted for most of the true score variance both overall and at the group factor level. The possible usefulness of factor scores is discussed.

[1]  Marley W. Watkins,et al.  Construct validity of the Spanish Version of the Wechsler Intelligence Scale for Children Fifth Edition (WISC-VSpain) , 2019 .

[2]  Gary L. Canivez,et al.  Challenges to the Cattell-Horn-Carroll Theory: Empirical, Clinical, and Policy Implications , 2019, Applied Measurement in Education.

[3]  Marley W. Watkins,et al.  Reliability and factorial validity of the Canadian Wechsler Intelligence Scale for Children–Fifth Edition , 2018 .

[4]  Marley W. Watkins,et al.  Exploratory Factor Analysis: A Guide to Best Practice , 2018 .

[5]  Marley W. Watkins,et al.  Factor Structure of the 10 WISC-V Primary Subtests Across Four Standardization Age Groups , 2018 .

[6]  Stefan C. Dombrowski,et al.  An Alternative Conceptualization of the Theoretical Structure of the Woodcock-Johnson IV Tests of Cognitive Abilities at School Age: A Confirmatory Factor Analytic Investigation , 2018 .

[7]  Gary L. Canivez,et al.  Complementary Exploratory and Confirmatory Factor Analyses of the French WISC–V: Analyses Based on the Standardization Sample , 2017, Psychological assessment.

[8]  Jeffrey M. Cucina,et al.  Woodcock-Johnson-III, Kaufman Adolescent and Adult Intelligence Test (KAIT), Kaufman Assessment Battery for Children (KABC), and Differential Ability Scales (DAS) Support Carroll but Not Cattell-Horn , 2017, Psychological assessment.

[9]  Stefan C. Dombrowski,et al.  Hierarchical Exploratory Factor Analyses of the Woodcock-Johnson IV Full Test Battery: Implications for CHC Application in School Psychology , 2017, School psychology quarterly : the official journal of the Division of School Psychology, American Psychological Association.

[10]  R. Crutzen,et al.  Scale quality: alpha is an inadequate estimate and factor-analytic evidence is needed first of all , 2017, Health psychology review.

[11]  T. Keith,et al.  Multi-group and hierarchical confirmatory factor analysis of the Wechsler Intelligence Scale for Children—Fifth Edition: What does it measure? , 2017 .

[12]  Marley W. Watkins,et al.  The reliability of multidimensional neuropsychological measures: from alpha to omega , 2017, The Clinical neuropsychologist.

[13]  Marley W. Watkins,et al.  Structural Validity of the Wechsler Intelligence Scale for Children–Fifth Edition: Confirmatory Factor Analyses With the 16 Primary and Secondary Subtests , 2017, Psychological assessment.

[14]  Stefan C. Dombrowski,et al.  Exploratory and Hierarchical Factor Analysis of the WJ-IV Cognitive at School Age , 2017, Psychological assessment.

[15]  Marley W. Watkins,et al.  Factor structure of the Wechsler Intelligence Scale for Children-Fifth Edition: Exploratory factor analyses with the 16 primary and secondary subtests. , 2016, Psychological assessment.

[16]  Kristof Kovacs,et al.  Process Overlap Theory: A Unified Account of the General Factor of Intelligence , 2016 .

[17]  J. Divers,et al.  A Comparison of Composite Reliability Estimators , 2016, Educational and psychological measurement.

[18]  Florian Domnick,et al.  Intelligence and school grades: A meta-analysis , 2015 .

[19]  Marley W. Watkins,et al.  Exploratory bifactor analysis of the Wechsler Intelligence Scale for Children—Fifth Edition with the 16 primary and secondary subtests , 2015 .

[20]  Stefan C. Dombrowski Investigating the Structure of the WJ-III Cognitive in Early School Age Through Two Exploratory Bifactor Analysis Procedures , 2014 .

[21]  Marley W. Watkins,et al.  Structural and incremental validity of the Wechsler Adult Intelligence Scale-Fourth Edition with a clinical sample. , 2013, Psychological assessment.

[22]  S. Reise,et al.  Scoring and Modeling Psychological Measures in the Presence of Multidimensionality , 2013, Journal of personality assessment.

[23]  Marley W. Watkins,et al.  Exploratory and higher order factor analysis of the WJ-III full test battery: a school-aged analysis. , 2013, Psychological assessment.

[24]  Gerhard Mels,et al.  Choosing the Optimal Number of Factors in Exploratory Factor Analysis: A Model Selection Perspective , 2013, Multivariate behavioral research.

[25]  S. Reise The Rediscovery of Bifactor Measurement Models , 2012 .

[26]  Dimitra Dodou,et al.  Factor recovery by principal axis factoring and maximum likelihood factor analysis as a function of factor pattern and sample size , 2012 .

[27]  Stanislav Kolenikov,et al.  Testing Negative Error Variances , 2012 .

[28]  R. Kievit,et al.  On the Interpretation of the CHC Factor Gc. , 2011 .

[29]  T. Schmitt Current Methodological Considerations in Exploratory and Confirmatory Factor Analysis , 2011 .

[30]  Marley W. Watkins,et al.  Exploratory and higher-order factor analyses of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) adolescent subsample. , 2010 .

[31]  Marley W. Watkins,et al.  Investigation of the factor structure of the Wechsler Adult Intelligence Scale--Fourth Edition (WAIS-IV): exploratory and higher order factor analyses. , 2010, Psychological assessment.

[32]  Christian Tarchi,et al.  Reading comprehension of informative texts in secondary school: A focus on direct and indirect effects of reader's prior knowledge , 2010 .

[33]  Timothy Z. Keith,et al.  Cattell-Horn-Carroll Abilities and Cognitive Tests: What We've Learned from 20 Years of Research. , 2010 .

[34]  A. Kaufman,et al.  Kaufman Adolescent and Adult Intelligence Test , 2010 .

[35]  Carmen Ximénez,et al.  Recovery of weak factor loadings in confirmatory factor analysis under conditions of model misspecification , 2009, Behavior research methods.

[36]  E. Tucker-Drob,et al.  Differentiation of Cognitive Abilities across the Lifespan , 2010 .

[37]  Marley W. Watkins,et al.  An Exploratory Investigation of the Factor Structure of the Reynolds Intellectual Assessment Scales (RIAS) , 2009 .

[38]  I. Deary,et al.  IQ in Early Adulthood, Socioeconomic Position, and Unintentional Injury Mortality by Middle Age: A Cohort Study of More Than 1 Million Swedish Men , 2008, American journal of epidemiology.

[39]  Gary L. Canivez Orthogonal Higher Order Factor Structure of the Stanford-Binet Intelligence Scales—Fifth Edition for Children and Adolescents , 2008 .

[40]  G. Farkas,et al.  Mathematics Growth in Early Elementary School: The Roles of Beginning Knowledge, Student Engagement, and Instruction , 2007, The Elementary School Journal.

[41]  F. Chen Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance , 2007 .

[42]  Thomas W. Frazier,et al.  Historical increase in the number of factors measured by commercial tests of cognitive ability: Are we overfactoring? , 2007 .

[43]  Tracy Packiam Alloway,et al.  Verbal and visuospatial short-term and working memory in children: are they separable? , 2006, Child development.

[44]  Selcuk R. Sirin Socioeconomic Status and Academic Achievement: A Meta-Analytic Review of Research , 2005 .

[45]  Jason W. Osborne,et al.  Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. , 2005 .

[46]  David R. Anderson,et al.  Multimodel Inference , 2004 .

[47]  James C. Hayton,et al.  Factor Retention Decisions in Exploratory Factor Analysis: a Tutorial on Parallel Analysis , 2004 .

[48]  Ian J. Deary,et al.  Intelligence Predicts Health and Longevity, but Why? , 2004 .

[49]  A. Baddeley Working memory and language: an overview. , 2003, Journal of communication disorders.

[50]  Robert C MacCallum,et al.  Recovery of Weak Common Factors by Maximum Likelihood and Ordinary Least Squares Estimation , 2003, Multivariate behavioral research.

[51]  Gordon W. Cheung,et al.  Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance , 2002 .

[52]  Duane T. Wegener,et al.  Evaluating the use of exploratory factor analysis in psychological research. , 1999 .

[53]  R. MacCallum,et al.  Sample size in factor analysis. , 1999 .

[54]  Michael C. Pyryt Human cognitive abilities: A survey of factor analytic studies , 1998 .

[55]  W. Velicer,et al.  Affects of variable and subject sampling on factor pattern recovery. , 1998 .

[56]  B. Bracken Differential Ability Scales , 1996, Encyclopedia of Autism Spectrum Disorders.

[57]  青山 真二,et al.  アメリカ合衆国におけるKaufman Assessment Battery for Childrenに関する研究動向 , 1995 .

[58]  A. Kaufman Joint Exploratory Factor Analysis of the Kaufman Assessment Battery for Children and the Kaufman Adolescent and Adult Intelligence Test for 11- and 12-Year-Olds , 1993 .

[59]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[60]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[61]  R. Cattell,et al.  Refinement and test of the theory of fluid and crystallized general intelligences. , 1966, Journal of educational psychology.

[62]  R. Cattell The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[63]  J. Horn A rationale and test for the number of factors in factor analysis , 1965, Psychometrika.

[64]  H. Kaiser The Application of Electronic Computers to Factor Analysis , 1960 .

[65]  John Schmid,et al.  The development of hierarchical factor solutions , 1957 .

[66]  C. Spearman General intelligence Objectively Determined and Measured , 1904 .

[67]  W. Revelle psych: Procedures for Personality and Psychological Research , 2017 .

[68]  T. Brown Confirmatory factor analysis for applied research, 2nd ed. , 2015 .

[69]  Gilles E. Gignac On the Inappropriateness of Using Items to Calculate Total Scale Score Reliability via Coefficient Alpha for Multidimensional Scales , 2014 .

[70]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[71]  Stanislav Kolenikov,et al.  Testing Negative Error Variances: Is a Heywood Case a Symptom of Misspecification? , 2010 .

[72]  K. McGrew CHC theory and the human cognitive abilities project: Standing on the shoulders of the giants of psychometric intelligence research , 2009 .

[73]  A. Grob,et al.  IDS: Intelligence and Development Scales : Intelligenz- und Entwicklungsskalen für Kinder von 5-10 Jahren , 2009 .

[74]  Gilles E. Gignac Multi-factor modeling in individual differences research: Some recommendations and suggestions , 2007 .

[75]  Dawn P. Flanagan,et al.  The Impact of the Cattell-Horn-Carroll Theory on Test Development and Interpretation of Cognitive and Academic Abilities. , 2005 .

[76]  Timothy Z. Keith,et al.  Using Confirmatory Factor Analysis to Aid in Understanding the Constructs Measured by Intelligence Tests. , 2005 .

[77]  D. Lubinski Introduction to the special section on cognitive abilities: 100 years after Spearman's (1904) "'General intelligence,' objectively determined and measured". , 2004, Journal of personality and social psychology.

[78]  L. Gottfredson,et al.  Intelligence: is it the epidemiologists' elusive "fundamental cause" of social class inequalities in health? , 2004, Journal of personality and social psychology.

[79]  Kevin S. McGrew,et al.  Analysis of the major intelligence batteries according to a proposed comprehensive Gf-Gc framework. , 1997 .

[80]  J. H. Steiger Statistically based tests for the number of common factors , 1980 .