Using Bifactor Models to Examine the Predictive Validity of Hierarchical Constructs: Pros, Cons, and Solutions

The use of bifactor models has increased substantially in the past decade. However, bifactor models are prone to a nonidentification problem in the context of prediction that is not well recognized...

[1]  Moritz Heene,et al.  Anomalous Results in G-Factor Models: Explanations and Alternatives , 2017, Psychological methods.

[2]  M. Ashton,et al.  Empirical, Theoretical, and Practical Advantages of the HEXACO Model of Personality Structure , 2007, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[3]  Larry J. Williams,et al.  The Myth of Global Fit Indices and Alternatives for Assessing Latent Variable Relations , 2011 .

[4]  O. Wilhelm,et al.  A tutorial on hierarchically structured constructs. , 2012, Journal of personality.

[5]  Wes Bonifay,et al.  On the Complexity of Item Response Theory Models , 2017, Multivariate behavioral research.

[6]  T. Raykov,et al.  Revisiting the Bi-Factor Model: Can Mixture Modeling Help Assess Its Applicability? , 2019 .

[7]  Joshua J. Jackson,et al.  Obsessive, compulsive, and conscientious? The relationship between OCPD and personality traits. , 2018, Journal of personality.

[8]  David Rindskopf,et al.  Structural Equation Models , 1984 .

[9]  S. West,et al.  A Comparison of Bifactor and Second-Order Models of Quality of Life , 2006, Multivariate behavioral research.

[10]  David Thissen,et al.  On the relationship between the higher-order factor model and the hierarchical factor model , 1999 .

[11]  Herbert W. Marsh,et al.  The Hierarchical Structure of Self-Concept and the Application of Hierarchical Confirmatory Factor Analysis , 1987 .

[12]  Charles E Lance,et al.  A taxonomy of path-related goodness-of-fit indices and recommended criterion values. , 2016, Psychological methods.

[13]  Li Cai,et al.  A Two-Tier Full-Information Item Factor Analysis Model with Applications , 2010 .

[14]  Michele Morales Olea,et al.  Predicting pilot and navigator criteria : not much more than g , 1994 .

[15]  B. Muthén,et al.  Nesting and Equivalence Testing for Structural Equation Models , 2018, Structural Equation Modeling: A Multidisciplinary Journal.

[16]  G. Box.  Science and Statistics , 1976 .

[17]  M. S. Teachout,et al.  Pervasiveness of Dominant General Factors in Organizational Measurement , 2015, Industrial and Organizational Psychology.

[18]  S. Reise.  The Rediscovery of Bifactor Measurement Models , 2012 .

[19]  Gilles E. Gignac,et al.  At what sample size do latent variable correlations stabilize? , 2018, Journal of Research in Personality.

[20]  Eric D. Heggestad,et al.  Scale Adaptation in Organizational Science Research: A Review and Best-Practice Recommendations , 2019, Journal of Management.

[21]  B. Muthén,et al.  Exploratory Structural Equation Modeling , 2009 .

[22]  B. Hilbig,et al.  The Dark Core of Personality , 2018, Psychological review.

[23]  Serena Wee.  Aligning Predictor-Criterion Bandwidths: Specific Abilities as Predictors of Specific Performance , 2018, Journal of Intelligence.

[24]  K. Bollen,et al.  Improper Solutions in Structural Equation Models , 2001 .

[25]  Donald Hedeker,et al.  Full-Information Item Bifactor Analysis of Graded Response Data , 2007 .

[26]  Gilles E. Gignac.  The higher-order model imposes a proportionality constraint: That is why the bifactor model tends to fit better , 2016 .

[27]  Peter M. Bentler,et al.  Exploratory Bi-Factor Analysis , 2011, Psychometrika.

[28]  Florian Schmiedek,et al.  Toward an alternative representation for disentangling age-associated differences in general and specific cognitive abilities. , 2004, Psychology and aging.

[29]  M. Ree,et al.  PREDICTING TRAINING SUCCESS: NOT MUCH MORE THAN g , 2006 .

[30]  L. R. Goldberg,et al.  THE STRUCTURE OF CONSCIENTIOUSNESS: AN EMPIRICAL INVESTIGATION BASED ON SEVEN MAJOR PERSONALITY QUESTIONNAIRES , 2005 .

[31]  J. Hofmans,et al.  The multiple face(t)s of state conscientiousness: Predicting task performance and organizational citizenship behavior☆ , 2017 .

[32]  Donald Hedeker,et al.  Full-information item bi-factor analysis , 1992 .

[33]  M. Miller,et al.  Sample Size Requirements for Structural Equation Models , 2013, Educational and psychological measurement.

[34]  R. Philip Chalmers,et al.  mirt: A Multidimensional Item Response Theory Package for the R Environment , 2012 .

[35]  Li Cai,et al.  Generalized full-information item bifactor analysis. , 2011, Psychological methods.

[36]  Facets of personality and “ideological asymmetries” , 2018, Journal of Research in Personality.

[37]  R. P. McDonald,et al.  Principles and practice in reporting structural equation analyses. , 2002, Psychological methods.

[38]  P. Costa,et al.  Domains and facets: hierarchical personality assessment using the revised NEO personality inventory. , 1995, Journal of personality assessment.

[39]  Martin Brunner,et al.  The structure of academic self-concepts revisited: The nested Marsh/Shavelson model , 2010 .

[40]  Gilles E. Gignac.  Partial Confirmatory Factor Analysis: Described and Illustrated on the NEO–PI–R , 2009, Journal of personality assessment.

[41]  Joseph A. Cote,et al.  Multicollinearity and Measurement Error in Structural Equation Models: Implications for Theory Testing , 2004 .

[42]  Steven P. Reise,et al.  The role of the bifactor model in resolving dimensionality issues in health outcomes measures , 2007, Quality of Life Research.

[43]  Yves Rosseel,et al.  lavaan: An R Package for Structural Equation Modeling , 2012 .

[44]  F. Schmidt,et al.  General mental ability in the world of work: occupational attainment and job performance. , 2004, Journal of personality and social psychology.

[45]  Albert Satorra,et al.  Testing model nesting and equivalence. , 2008, Psychological methods.

[46]  O. John,et al.  The Next Big Five Inventory (BFI-2): Developing and Assessing a Hierarchical Model With 15 Facets to Enhance Bandwidth, Fidelity, and Predictive Power , 2017, Journal of personality and social psychology.

[47]  Fritz Drasgow,et al.  A test of the measurement equivalence of the revised Job Diagnostic Survey: Past problems and current solutions. , 1988 .

[48]  K. Holzinger,et al.  The Bi-factor method , 1937 .

[49]  A. Boomsma.  Nonconvergence, improper solutions, and starting values in lisrel maximum likelihood estimation , 1985 .

[50]  L. Tay,et al.  Modeling congruence in organizational research with latent moderated structural equations. , 2019, The Journal of applied psychology.

[51]  S. Reise,et al.  Evaluating bifactor models: Calculating and interpreting statistical indices. , 2016, Psychological methods.

[52]  Malcolm James Ree,et al.  Predicting job performance: Not much more than g.. , 1994 .

[53]  T. Salthouse.  Relation of successive percentiles of reaction time distributions to cognitive variables and adult age , 1998 .

[54]  Minjeong Jeon,et al.  Flexible Item Response Theory Modeling With FLIRT , 2014 .

[55]  Jonas W. B. Lang,et al.  Specific Abilities in the Workplace: More Important Than g? , 2017, Journal of Intelligence.

[56]  B. Muthén,et al.  How to Use a Monte Carlo Study to Decide on Sample Size and Determine Power , 2002 .

[57]  J. Laurenceau,et al.  Modeling general and specific variance in multifaceted constructs: a comparison of the bifactor model to other approaches. , 2012, Journal of personality.

[58]  Maxwell Mansolf,et al.  Exploratory Bifactor Analysis: The Schmid-Leiman Orthogonalization and Jennrich-Bentler Analytic Rotations , 2016, Multivariate behavioral research.

[59]  Thomas A Widiger,et al.  A meta-analytic review of the relationships between the five-factor model and DSM-IV-TR personality disorders: a facet level analysis. , 2008, Clinical psychology review.

[60]  Yiming Jing,et al.  Two Concepts or Two Approaches? A Bifactor Analysis of Psychological and Subjective Well-Being , 2013 .

[61]  Peter M Bentler,et al.  Exploratory Bi-factor Analysis: The Oblique Case , 2012, Psychometrika.

[62]  James C. Anderson,et al.  The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis , 1984 .

[63]  Edgar C. Merkle,et al.  Testing non-nested structural equation models , 2014, 1402.6720.

[64]  John Schmid,et al.  The development of hierarchical factor solutions , 1957 .

[65]  James G. Field,et al.  Correlational effect size benchmarks. , 2015, The Journal of applied psychology.

[66]  Timothy R. Hinkin.  A Review of Scale Development Practices in the Study of Organizations , 1995 .

[67]  R. C. Fraley,et al.  Are adult attachment styles categorical or dimensional? A taxometric analysis of general and relationship-specific attachment orientations. , 2015, Journal of personality and social psychology.

[68]  Matthew Sigal,et al.  Play It Again: Teaching Statistics With Monte Carlo Simulation , 2016 .

[69]  S. Reise,et al.  Is the Bifactor Model a Better Model or Is It Just Better at Modeling Implausible Responses? Application of Iteratively Reweighted Least Squares to the Rosenberg Self-Esteem Scale , 2016, Multivariate behavioral research.

[70]  Jonas W. B. Lang,et al.  The Great Debate: General Ability and Specific Abilities in the Prediction of Important Outcomes , 2018, Journal of Intelligence.

[71]  Daniel A. Newman,et al.  More than g: selection quality and adverse impact implications of considering second-stratum cognitive abilities. , 2014, The Journal of applied psychology.

[72]  Frederick L. Oswald,et al.  Bifactor Models of Personality and College Student Performance: A Broad versus Narrow View , 2014 .

[73]  K. McGrew.  CHC theory and the human cognitive abilities project: Standing on the shoulders of the giants of psychometric intelligence research , 2009 .

[74]  M. Seligman,et al.  The Factor Structure of the Values in Action Inventory of Strengths (VIA-IS): An Item-Level Exploratory Structural Equation Modeling (ESEM) Bifactor Analysis , 2017, Psychological assessment.

[75]  S. Reise,et al.  Bifactor Models and Rotations: Exploring the Extent to Which Multidimensional Data Yield Univocal Scale Scores , 2010, Journal of personality assessment.

[76]  Christopher D. Nye,et al.  More than g : Evidence for the Incremental Validity of Performance‐Based Assessments for Predicting Training Performance , 2018, Applied Psychology.

[77]  Eean R. Crawford,et al.  Hierarchical representations of the five-factor model of personality in predicting job performance: integrating three organizing frameworks with two theoretical perspectives. , 2013, The Journal of applied psychology.

[78]  Y. Rosseel,et al.  Local fit evaluation of structural equation models using graphical criteria. , 2017, Psychological methods.

[79]  K. Grimm,et al.  Augmenting the Correlated Trait–Correlated Method Model for Multitrait–Multimethod Data , 2016 .

[80]  C. F. Bond,et al.  One Hundred Years of Social Psychology Quantitatively Described , 2003 .

[81]  Michael Eid,et al.  Bifactor Models for Predicting Criteria by General and Specific Factors: Problems of Nonidentifiability and Alternative Solutions , 2018, Journal of Intelligence.

[82]  Aja Louise Murray,et al.  The limitations of model fit in comparing the bi-factor versus higher-order models of human cognitive ability structure , 2013 .

[83]  Kristian E Markon,et al.  Bifactor and Hierarchical Models: Specification, Inference, and Interpretation. , 2019, Annual review of clinical psychology.

[84]  Sandhya Ramrakha,et al.  The p Factor , 2014, Clinical psychological science : a journal of the Association for Psychological Science.

[85]  Richard Scheines,et al.  Multidimensionality and Structural Coefficient Bias in Structural Equation Modeling , 2013 .

[86]  J. Gustafsson,et al.  General and Specific Abilities as Predictors of School Achievement. , 1993, Multivariate behavioral research.