A Bifactor Exploratory Structural Equation Modeling Framework for the Identification of Distinct Sources of Construct-Relevant Psychometric Multidimensionality

This study illustrates an overarching psychometric approach of broad relevance to investigations of 2 sources of construct-relevant psychometric multidimensionality present in many complex multidimensional instruments routinely used in psychological and educational research. These 2 sources of construct-relevant psychometric multidimensionality are related to (a) the fallible nature of indicators as perfect indicators of a single construct, and (b) the hierarchical nature of the constructs being assessed. The first source is identified by comparing confirmatory factor analytic (CFA) and exploratory structural equation modeling (ESEM) solutions. The second source is identified by comparing first-order, hierarchical, and bifactor measurement models. To provide an applied illustration of the substantive relevance of this framework, we first apply these models to a sample of German children (N = 1,957) who completed the Self-Description Questionnaire (SDQ–I). Then, in a second study using a simulated data set, we provide a more pedagogical illustration of the proposed framework and the broad range of possible applications of bifactor ESEM models.

[1]  H. Caci,et al.  Factorial Validity of the ADHD Adult Symptom Rating Scale in a French Community Sample , 2016, Journal of attention disorders.

[2]  H. Caci,et al.  Teacher Ratings of the ADHD-RS IV in a Community Sample , 2016, Journal of attention disorders.

[3]  Sabrina Eberhart,et al.  Applied Missing Data Analysis , 2016 .

[4]  Andreas Ritter,et al.  Structural Equations With Latent Variables , 2016 .

[5]  Herbert W Marsh,et al.  Exploratory structural equation modeling: an integration of the best features of exploratory and confirmatory factor analysis. , 2014, Annual review of clinical psychology.

[6]  B. Jean Mandernach,et al.  Journal on Educational Psychology , 2014 .

[7]  Nilam Ram,et al.  Exploratory Latent Growth Models in the Structural Equation Modeling Framework , 2013 .

[8]  Aja Louise Murray,et al.  The limitations of model fit in comparing the bi-factor versus higher-order models of human cognitive ability structure , 2013 .

[9]  Gilles E. Gignac,et al.  Bifactor Modeling and the Estimation of Model-Based Reliability in the WAIS-IV , 2013, Multivariate behavioral research.

[10]  A. Yeung,et al.  A short German version of the Self Description Questionnaire I: theoretical and empirical comparability , 2013 .

[11]  H. Marsh,et al.  Why item parcels are (almost) never appropriate: two wrongs do not make a right--camouflaging misspecification with item parcels in CFA models. , 2013, Psychological methods.

[12]  Benjamin Nagengast,et al.  Measurement invariance of big-five factors over the life span: ESEM tests of gender, age, plasticity, maturity, and la dolce vita effects. , 2013, Developmental psychology.

[13]  A. Hayes.  Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach , 2013 .

[14]  P. Jose.  Doing Statistical Mediation and Moderation , 2013 .

[15]  Faisal Abdelfattah,et al.  Factorial, Convergent, and Discriminant Validity of TIMSS Math and Science Motivation Measures: A Comparison of Arab and Anglo-Saxon Countries , 2013 .

[16]  Gregory R. Hancock,et al.  Structural equation modeling: A second course, 2nd ed. , 2013 .

[17]  Christina S. Werner,et al.  Measurement Bias Detection Through Factor Analysis , 2012 .

[18]  Karl Schweizer Editor-in-Chief.  On Correlated Errors , 2012 .

[19]  S. Reise.  The Rediscovery of Bifactor Measurement Models , 2012 .

[20]  O. Wilhelm,et al.  A tutorial on hierarchically structured constructs. , 2012, Journal of personality.

[21]  Peter M Bentler,et al.  Exploratory Bi-factor Analysis: The Oblique Case , 2012, Psychometrika.

[22]  Gordon W. Cheung,et al.  A Direct Comparison Approach for Testing Measurement Invariance , 2012 .

[23]  D. Fadda,et al.  Validation of an Italian Version of the Oxford Happiness Inventory in Adolescence , 2012, Journal of personality assessment.

[24]  A. Yeung,et al.  The twofold multidimensionality of academic self-concept : domain specificity and separation between competence and affect components , 2011 .

[25]  A. Morin,et al.  Cross-validation of the short form of the physical self-inventory (PSI-S) using exploratory structural equation modeling (ESEM) , 2011 .

[26]  H. Marsh,et al.  Construct Validity of the Multidimensional Structure of Bullying and Victimization: An Application of Exploratory Structural Equation Modeling. , 2011 .

[27]  Tyler M. Moore,et al.  Target Rotations and Assessing the Impact of Model Violations on the Parameters of Unidimensional Item Response Theory Models , 2011 .

[28]  Andrew J. Martin,et al.  Methodological Measurement Fruitfulness of Exploratory Structural Equation Modeling (ESEM): New Approaches to Key Substantive Issues in Motivation and Engagement , 2011 .

[29]  Peter M. Bentler,et al.  Exploratory Bi-Factor Analysis , 2011, Psychometrika.

[30]  Daniel A. Sass,et al.  Rotation Criteria and Hypothesis Testing for Exploratory Factor Analysis: Implications for Factor Pattern Loadings and Interfactor Correlations , 2011 .

[31]  Self-concepts in Japanese and American Elementary School Children: Psychometric Analysis of the Self-Description Questionnaire I (SDQ-I) , 2011 .

[32]  Martin Brunner,et al.  The structure of academic self-concepts revisited: The nested Marsh/Shavelson model , 2010 .

[33]  S. Reise,et al.  Bifactor Models and Rotations: Exploring the Extent to Which Multidimensional Data Yield Univocal Scale Scores , 2010, Journal of personality assessment.

[34]  Ulrich Trautwein,et al.  A new look at the big five factor structure through exploratory structural equation modeling. , 2010, Psychological assessment.

[35]  H. Marsh,et al.  Longitudinal tests of competing factor structures for the Rosenberg Self-Esteem Scale: traits, ephemeral artifacts, and stable response styles. , 2010, Psychological assessment.

[36]  Frans J. Oort,et al.  Using restricted factor analysis with latent moderated structures to detect uniform and nonuniform measurement bias; a simulation study , 2010 .

[37]  Martin Brunner,et al.  The cross-cultural generalizability of a new structural model of academic self-concepts , 2009 .

[38]  H. Marsh,et al.  A Meta-Analytic Path Analysis of the Internal/External Frame of Reference Model of Academic Achievement and Academic Self-Concept , 2009 .

[39]  B. Muthén,et al.  Exploratory Structural Equation Modeling , 2009 .

[40]  Ulrich Trautwein,et al.  Please Scroll down for Article Structural Equation Modeling: a Multidisciplinary Journal Exploratory Structural Equation Modeling, Integrating Cfa and Efa: Application to Students' Evaluations of University Teaching , 2022 .

[41]  Xitao Fan,et al.  Using ΔGoodness-of-Fit Indexes in Assessing Mean Structure Invariance , 2009 .

[42]  J. Graham,et al.  Missing data analysis: making it work in the real world. , 2009, Annual review of psychology.

[43]  M. Eid,et al.  Structural equation modeling of multitrait-multimethod data: different models for different types of methods. , 2008, Psychological methods.

[44]  David Watson,et al.  Parsing the general and specific components of depression and anxiety with bifactor modeling , 2008, Depression and anxiety.

[45]  Gordon W. Cheung,et al.  Testing Mediation and Suppression Effects of Latent Variables , 2008 .

[46]  U. Trautwein,et al.  The Internal/External Frame of Reference Model Revisited: Incorporating General Cognitive Ability and General Academic Self-Concept , 2008, Multivariate behavioral research.

[47]  D. Mackinnon.  Introduction to Statistical Mediation Analysis , 2008 .

[48]  Howard Eisner,et al.  Information Age , 2008, Wiley Encyclopedia of Computer Science and Engineering.

[49]  Matthew S. Fritz,et al.  Mediation analysis. , 2019, Annual review of psychology.

[50]  Gilles E. Gignac,et al.  A Confirmatory Factor Analytic Investigation of the TAS–20: Corroboration of a Five-Factor Model and Suggestions for Improvement , 2007, Journal of personality assessment.

[51]  Xitao Fan,et al.  Sensitivity of Fit Indices to Model Misspecification and Model Types , 2007 .

[52]  F. Chen.  Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance , 2007 .

[53]  Steven P. Reise,et al.  The role of the bifactor model in resolving dimensionality issues in health outcomes measures , 2007, Quality of Life Research.

[54]  Gilles E. Gignac.  Multi-factor modeling in individual differences research: Some recommendations and suggestions , 2007 .

[55]  Herbert W. Marsh,et al.  Multidimensional Self-Concept Structure for Preadolescents With Mild Intellectual Disabilities , 2006 .

[56]  S. West,et al.  A Comparison of Bifactor and Second-Order Models of Quality of Life , 2006, Multivariate behavioral research.

[57]  Gregory R. Hancock,et al.  Structural equation modeling : a second course , 2006 .

[58]  Xitao Fan,et al.  Sensitivity of Fit Indexes to Misspecified Structural or Measurement Model Components: Rationale of Two-Index Strategy Revisited , 2005 .

[59]  B. Avolio,et al.  . , 2005, The Leadership Quarterly.

[60]  H. Marsh,et al.  In Search of Golden Rules: Comment on Hypothesis-Testing Approaches to Setting Cutoff Values for Fit Indexes and Dangers in Overgeneralizing Hu and Bentler's (1999) Findings , 2004 .

[61]  David P Mackinnon,et al.  Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling Methods , 2004, Multivariate behavioral research.

[62]  H. Marsh,et al.  Do multiple dimensions of self-concept become more differentiated with age? The differential distinctiveness hypothesis , 2003 .

[63]  Gordon W. Cheung,et al.  Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance , 2002 .

[64]  M. Browne.  An Overview of Analytic Rotation in Exploratory Factor Analysis , 2001 .

[65]  David Thissen,et al.  On the relationship between the higher-order factor model and the hierarchical factor model , 1999 .

[66]  P. Bentler,et al.  Fit indices in covariance structure modeling : Sensitivity to underparameterized model misspecification , 1998 .

[67]  Maher M. Abu-Hilal,et al.  Dimensionality and Hierarchy of the Sdq in a Non-Western Milieu , 1997 .

[68]  B. Byrne.  Measuring Self-Concept Across the Life Span: Issues and Instrumentation , 1996 .

[69]  P. Costa,et al.  Evaluating replicability of factors in the Revised NEO Personality Inventory: Confirmatory factor analysis versus Procrustes rotation. , 1996 .

[70]  Walter P. Vispoel.  Self-concept in artistic domains: An extension of the Shavelson, Hubner, and Stanton (1976) model. , 1995 .

[71]  The Self-Description Questionnaire-1: A Lithuanian Application , 1995 .

[72]  D. Watkins,et al.  Assessing the Self‐esteem of Chinese School Children , 1994 .

[73]  W. Meredith.  Measurement invariance, factor analysis and factorial invariance , 1993 .

[74]  Duane T. Wegener,et al.  The problem of equivalent models in applications of covariance structure analysis. , 1993, Psychological bulletin.

[75]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[76]  D. Watkins,et al.  THE INTERNAL STRUCTURE OF THE SELF DESCRIPTION QUESTIONNAIRE: A NIGERIAN INVESTIGATION , 1992 .

[77]  J. H. Steiger.  Structural Model Evaluation and Modification: An Interval Estimation Approach. , 1990, Multivariate behavioral research.

[78]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[79]  Herbert W. Marsh,et al.  Age and sex effects in multiple dimensions of self-concept: Preadolescence to early adulthood. , 1989 .

[80]  B. Muthén.  Latent variable modeling in heterogeneous populations , 1989 .

[81]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[82]  D. Rindskopf,et al.  Some Theory and Applications of Confirmatory Second-Order Factor Analysis. , 1988, Multivariate behavioral research.

[83]  S. Sclove.  Application of model-selection criteria to some problems in multivariate analysis , 1987 .

[84]  H. Bozdogan.  Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions , 1987 .

[85]  H. Akaike.  Factor analysis and AIC , 1987 .

[86]  Herbert W. Marsh,et al.  The Hierarchical Structure of Self-Concept and the Application of Hierarchical Confirmatory Factor Analysis , 1987 .

[87]  H. Marsh,et al.  Application of confirmatory factor analysis to the study of self-concept: First- and higher order factor models and their invariance across groups. , 1985 .

[88]  J. Russell.  Developmental psychology , 1980, Nature.

[89]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[90]  R. Shavelson,et al.  Self-Concept: Validation of Construct Interpretations , 1976 .

[91]  A. Goldberger,et al.  Estimation of a Model with Multiple Indicators and Multiple Causes of a Single Latent Variable , 1975 .

[92]  Arthur S. Goldberger,et al.  Structural Equation Models in the Social Sciences. , 1974 .

[93]  L. Tucker,et al.  A reliability coefficient for maximum likelihood factor analysis , 1973 .

[94]  K. Jöreskog.  A General Method for Estimating a Linear Structural Equation System. , 1970 .

[95]  John Schmid,et al.  The development of hierarchical factor solutions , 1957 .

[96]  K. Holzinger,et al.  The Bi-factor method , 1937 .