Reliability and Validity of Bifactor Models of Dimensional Psychopathology in Youth from three Continents

Bifactor models are a promising strategy to parse general from specific aspects of psychopathology in youth. Currently, there are multiple configurations of bifactor models originating from different theoretical and empirical perspectives. We aimed to test the reliability, validity, measurement invariance, and the correlation of different bifactor models of psychopathology using the Child Behavior Checklist (CBCL). We used data from the Reproducible Brain Charts (RBC) initiative (N = 7,011, ages 5 to 22 years, 40.2% females). Factor models were tested using the baseline data. To address our aim, we (a) searched for the published item-level bifactor models using the CBCL; (b) tested their global model fit; (c) calculated model-based reliability indices; (d) tested associations with symptoms' impact in everyday life; (e) tested measurement invariance across many characteristics, and (f) analyzed the observed factor correlation across the models. We found 11 bifactor models ranging from 39 to 116 items. Their global model fit was broadly similar. Factor determinacy and H index were acceptable for the p-factors, internalizing, externalizing, and somatic specific factors in most models. However, only the p- and attention factors predicted daily life symptoms' impact in all models. Models were broadly invariant across different characteristics. P-factors were highly correlated across models (r = .88 to .99) and homotypic specific factors were highly correlated. These results suggest that regardless of item selection and strategy to compose CBCL bifactor models, they assess very similar constructs. Taken together, our results support the robustness of the p-factor across distinct bifactor models and studies of distinct characteristics. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

[1]  Ashley L. Watts,et al.  Three recommendations based on a comparison of the reliability and validity of the predominant models used in research on the empirical structure of psychopathology. , 2021, Journal of abnormal psychology.

[2]  E. Fried,et al.  The p factor is the sum of its parts, for now , 2021, World psychiatry : official journal of the World Psychiatric Association.

[3]  B. Franke,et al.  The P-factor and its genomic and neural equivalents: an integrated perspective , 2021, Molecular Psychiatry.

[4]  M. Berman,et al.  Association of gray matter volumes with general and specific dimensions of psychopathology in children , 2021, Neuropsychopharmacology.

[5]  D. Watson,et al.  What Is the General Factor of Psychopathology? Consistency of the p Factor Across Samples , 2020, Assessment.

[6]  Ashley L. Watts,et al.  Building Theories on Top of, and Not Independent of, Statistical Models: The Case of the p-factor , 2020, Psychological inquiry.

[7]  Arianna M. Gard,et al.  Differentiated nomological networks of internalizing, externalizing, and the general factor of psychopathology (‘p factor’) in emerging adolescence in the ABCD study , 2020, Psychological Medicine.

[8]  Xi-Nian Zuo,et al.  Cohort Profile: Chinese Color Nest Project , 2020 .

[9]  Malerie G. McDowell,et al.  Criterion Validity and Relationships between Alternative Hierarchical Dimensional Models of General and Specific Psychopathology , 2020, bioRxiv.

[10]  J. J. Li,et al.  Factorial invariance in hierarchical factor models of mental disorders in African American and European American youths. , 2020, Journal of child psychology and psychiatry, and allied disciplines.

[11]  A. Caspi,et al.  Longitudinal Assessment of Mental Health Disorders and Comorbidities Across 4 Decades Among Participants in the Dunedin Birth Cohort Study , 2020, JAMA network open.

[12]  C. Sripada,et al.  The General Factor of Psychopathology in the Adolescent Brain Cognitive Development (ABCD) Study: A Comparison of Alternative Modeling Approaches , 2020, Clinical psychological science : a journal of the Association for Psychological Science.

[13]  Gregory T. Smith,et al.  The General Factor of Psychopathology. , 2020, Annual review of clinical psychology.

[14]  Brenton M. Wiernik,et al.  Appropriate Use of Bifactor Analysis in Psychopathology Research: Appreciating Benefits and Limitations , 2020, Biological Psychiatry.

[15]  G. Ploubidis,et al.  A longitudinal examination of the measurement equivalence of mental health assessments in two British birth cohorts , 2019, Longitudinal and Life Course Studies.

[16]  P. Fonagy,et al.  Evaluating Bifactor Models of Psychopathology Using Model-Based Reliability Indices , 2019 .

[17]  Ashley L. Watts,et al.  Riskier Tests of the Validity of the Bifactor Model of Psychopathology , 2019, Clinical Psychological Science.

[18]  J. Belsky,et al.  General Psychopathology and Dysregulation Profile in a Longitudinal Community Sample: Stability, Antecedents and Outcomes , 2019, Child Psychiatry & Human Development.

[19]  Adon F. G. Rosen,et al.  Evidence for Dissociable Linkage of Dimensions of Psychopathology to Brain Structure in Youths. , 2019, The American journal of psychiatry.

[20]  S. Woltering,et al.  Evaluation of the Strengths and Difficulties Questionnaire-Dysregulation Profile (SDQ-DP) , 2018, Psychological assessment.

[21]  P. Szatmari,et al.  "P" and "DP:" Examining Symptom-Level Bifactor Models of Psychopathology and Dysregulation in Clinically Referred Children and Adolescents. , 2018, Journal of the American Academy of Child and Adolescent Psychiatry.

[22]  R. Bowles,et al.  Model Fit and Item Factor Analysis: Overfactoring, Underfactoring, and a Program to Guide Interpretation , 2018, Multivariate Behavioral Research.

[23]  Avshalom Caspi,et al.  All for One and One for All: Mental Disorders in One Dimension. , 2018, The American journal of psychiatry.

[24]  Joshua F. Wiley,et al.  MplusAutomation: An R Package for Facilitating Large-Scale Latent Variable Analyses in Mplus , 2018, Structural equation modeling : a multidisciplinary journal.

[25]  P. Vidal-Ribas,et al.  Should Clinicians Split or Lump Psychiatric Symptoms? The Structure of Psychopathology in Two Large Pediatric Clinical Samples from England and Norway , 2017, Child Psychiatry & Human Development.

[26]  J. Belsky,et al.  Developmental stability of general and specific factors of psychopathology from early childhood to adolescence: dynamic mutualism or p‐differentiation? , 2017, Journal of child psychology and psychiatry, and allied disciplines.

[27]  J. Antfolk,et al.  Phenotypic factor analysis of psychopathology reveals a new body-related transdiagnostic factor , 2017, PloS one.

[28]  S. Reise,et al.  Evaluating bifactor models: Calculating and interpreting statistical indices. , 2016, Psychological methods.

[29]  Mark A. Elliott,et al.  The Philadelphia Neurodevelopmental Cohort: A publicly available resource for the study of normal and abnormal brain development in youth , 2016, NeuroImage.

[30]  G. Salum,et al.  High risk cohort study for psychiatric disorders in childhood: rationale, design, methods and preliminary results , 2015, International journal of methods in psychiatric research.

[31]  Christine DiStefano,et al.  A Comparison of Diagonal Weighted Least Squares Robust Estimation Techniques for Ordinal Data , 2014 .

[32]  A. Stringaris,et al.  The Value of Measuring Impact Alongside Symptoms in Children and Adolescents: A Longitudinal Assessment in a Community Sample , 2013, Journal of abnormal child psychology.

[33]  Margaret D. King,et al.  The NKI-Rockland Sample: A Model for Accelerating the Pace of Discovery Science in Psychiatry , 2012, Front. Neurosci..

[34]  A. Hariri,et al.  Is there a general factor of prevalent psychopathology during adulthood? , 2012, Journal of abnormal psychology.

[35]  F. Chen.  Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance , 2007 .

[36]  E. Fombonne,et al.  Testing the 8-Syndrome Structure of the Child Behavior Checklist in 30 Societies , 2007, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[37]  H. Marsh,et al.  In Search of Golden Rules: Comment on Hypothesis-Testing Approaches to Setting Cutoff Values for Fit Indexes and Dangers in Overgeneralizing Hu and Bentler's (1999) Findings , 2004 .

[38]  R. Brookman.  The age of "adolescence". , 1995, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[39]  Waltz,et al.  Descriptor : An open resource for transdiagnostic research in pediatric mental health and learning disorders , 2019 .

[40]  Moritz Heene,et al.  Anomalous Results in G-Factor Models: Explanations and Alternatives , 2017, Psychological methods.

[41]  David M. Dueber.  Bifactor Indices Calculator: A Microsoft Excel-Based Tool to Calculate Various Indices Relevant to Bifactor CFA Models , 2017 .

[42]  Bengt,et al.  Latent Variable Analysis With Categorical Outcomes : Multiple-Group And Growth Modeling In Mplus , 2002 .

[43]  J W Grice,et al.  Computing and Evaluating Factor Scores , 2004 .

[44]  T. Achenbach.  Manual for ASEBA School-Age Forms & Profiles , 2001 .

[45]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .