Sex differences and gender‐invariance of mother‐reported childhood problem behavior

Prevalence and severity of childhood behavioral problems differ between boys and girls, and in psychiatry, testing for gender differences is common practice. Population‐based studies show that many psychopathology scales are (partially) Measurement Invariance (MI) with respect to gender, i.e. are unbiased. It is, however, unclear whether these studies generalize towards clinical samples. In a psychiatric outpatient sample, we tested whether the Child Behavior Checklist 6–18 (CBCL) is unbiased with respect to gender. We compared mean scores across gender of all syndrome scales of the CBCL in 3271 patients (63.3% boys) aged 6–18. Second, we tested for MI on both the syndrome scale and the item‐level using a stepwise modeling procedure. Six of the eight CBCL syndrome scales included one or more gender‐biased items (12.6% of all items), resulting in slight over‐ or under‐estimation of the absolute gender difference in mean scores. Two scales, Somatic Complaints and Rule‐breaking Behavior, contained no biased items. The CBCL is a valid instrument to measure gender differences in problem behavior in children and adolescents from a clinical sample; while various gender‐biased items were identified, the resulting bias was generally clinically irrelevant, and sufficient items per subscale remained after exclusion of biased items. Copyright © 2016 John Wiley & Sons, Ltd.

[1]  K. Schermelleh-Engel,et al.  Evaluating the Fit of Structural Equation Models: Tests of Significance and Descriptive Goodness-of-Fit Measures. , 2003 .

[2]  H. Remschmidt,et al.  Assessing child and adolescent anxiety in psychiatric samples with the Child Behavior Checklist. , 2010, Journal of anxiety disorders.

[3]  J. Stockman Lifetime Prevalence of Mental Disorders in U.S. Adolescents: Results from the National Comorbidity Survey Replication–Adolescent Supplement (NCS-A) , 2012 .

[4]  M. Sawyer,et al.  The factorial invariance of the CES-D during adolescence: are symptom profiles for depression stable across gender and time? , 2013, Journal of adolescence.

[5]  C. Edelbrock,et al.  The Child Behavior Profile: II. Boys aged 12-16 and girls aged 6-11 and 12-16. , 1979, Journal of consulting and clinical psychology.

[6]  J. Constantino,et al.  Confirmatory factor analytic structure and measurement invariance of quantitative autistic traits measured by the Social Responsiveness Scale-2 , 2014, Autism : the international journal of research and practice.

[7]  James G. Scott,et al.  The Child Behavior Checklist and Youth Self-Report in adolescents with epilepsy: Testing measurement invariance of the Attention and Thought Problems subscales , 2014, Epilepsy & Behavior.

[8]  Charles M Judd,et al.  Measurement Invariance of the Beck Depression Inventory–Second Edition (BDI-II) Across Gender, Race, and Ethnicity in College Students , 2013, Assessment.

[9]  E. Costello,et al.  Perceived parental burden and service use for child and adolescent psychiatric disorders. , 1998, American journal of public health.

[10]  M. Cox,et al.  Trajectories of internalizing problems across childhood: Heterogeneity, external validity, and gender differences , 2007, Development and Psychopathology.

[11]  D. Mroczek,et al.  The neglect of response bias in mental health research. , 2001, The Journal of nervous and mental disease.

[12]  D. Eignor The standards for educational and psychological testing. , 2013 .

[13]  M. Weissman,et al.  Gender and the prevalence of psychiatric disorders. , 2007 .

[14]  M. Cyders Impulsivity and the Sexes , 2013, Assessment.

[15]  T. Achenbach Manual for the child behavior checklist/4-18 and 1991 profile , 1991 .

[16]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[17]  J. Ormel,et al.  Does the Revised Child Anxiety and Depression Scale (RCADS) measure anxiety symptoms consistently across adolescence? The TRAILS study , 2013, International journal of methods in psychiatric research.

[18]  J. Muñiz,et al.  Measurement invariance of the Schizotypal Personality Questionnaire-Brief across gender and age , 2011, Psychiatry Research.

[19]  S. Yao,et al.  Factor structure of the CES-D and measurement invariance across gender in Mainland Chinese adolescents. , 2013, Journal of clinical psychology.

[20]  Thought Problems from Adolescence to Adulthood: Measurement Invariance and Longitudinal Heritability , 2011, Behavior genetics.

[21]  D. Boomsma,et al.  A Study of Genetic and Environmental Influences on Maternal and Paternal CBCL Syndrome Scores in a Large Sample of 3-Year-Old Dutch Twins , 2004, Behavior genetics.

[22]  Wolff Schlotz,et al.  The Perceived Stress Reactivity Scale: measurement invariance, stability, and validity in three countries. , 2011, Psychological assessment.

[23]  K. Merikangas,et al.  Lifetime prevalence of mental disorders in U.S. adolescents: results from the National Comorbidity Survey Replication--Adolescent Supplement (NCS-A). , 2010, Journal of the American Academy of Child and Adolescent Psychiatry.

[24]  J. Jenkins,et al.  Assessing the measurement invariance of the Center for Epidemiologic Studies Depression Scale across immigrant and non-immigrant women in the postpartum period , 2011, Archives of Women's Mental Health.

[25]  M. Boyle,et al.  Longitudinal invariance of measurement and structure of global self-concept: a population-based study examining trajectories among adolescents with and without chronic illness. , 2013, Journal of pediatric psychology.

[26]  P. Kendall,et al.  A symptom-level examination of parent-child agreement in the diagnosis of anxious youths. , 2004, Journal of the American Academy of Child and Adolescent Psychiatry.

[27]  M. Kirkovski,et al.  A Review of the Role of Female Gender in Autism Spectrum Disorders , 2013, Journal of autism and developmental disorders.

[28]  Katherine E. Belon,et al.  Testing the measurement invariance of the Eating Disorder Inventory in nonclinical samples of Hispanic and Caucasian women. , 2015, The International journal of eating disorders.

[29]  J. Muñiz,et al.  Dimensional structure and measurement invariance of the youth self-report across gender and age. , 2012, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[30]  E. Buchanan,et al.  A Measurement Invariance Examination of the Revised Child Anxiety and Depression Scale in a Southern Sample , 2013, Assessment.

[31]  T. Fergus,et al.  The Intolerance of Uncertainty Scale , 2013, Assessment.

[32]  Pei-Chen Wu,et al.  Gender-Related Invariance of the Beck Depression Inventory II for Taiwanese Adolescent Samples , 2014, Assessment.

[33]  R. Vandenberg,et al.  A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research , 2000 .

[34]  C. Gillberg,et al.  Girls with social deficits and learning problems: Autism, atypical Asperger syndrome or a variant of these conditions , 1992, European Child & Adolescent Psychiatry.

[35]  M. Z. Goldstein,et al.  Age and Gender Considerations in Psychiatric Diagnosis: A Research Agenda for DSM-V , 2009 .

[36]  P. Ratner,et al.  Gender-based measurement invariance of the substance use risk profile scale. , 2014, Addictive behaviors.

[37]  M. Willoughby,et al.  Executive function in early childhood: longitudinal measurement invariance and developmental change. , 2012, Psychological assessment.

[38]  M. Grunwald The Science Of Prevention Methodological Advances From Alcohol And Substance Abuse Research , 2016 .

[39]  T. Achenbach Manual for ASEBA School-Age Forms & Profiles , 2001 .

[40]  A. Lundervold,et al.  Symptoms of depression as reported by Norwegian adolescents on the Short Mood and Feelings Questionnaire , 2013, Front. Psychol..

[41]  L. Angeles Evaluating Cutoff Criteria of Model Fit Indices for Latent Variable Models with Binary and Continuous Outcomes , 2002 .

[42]  Roger E. Millsap,et al.  Assessing Factorial Invariance in Ordered-Categorical Measures , 2004 .

[43]  M. Rutter,et al.  Precision, reliability and accuracy in the dating of symptom onsets in child and adolescent psychopathology. , 1996, Journal of child psychology and psychiatry, and allied disciplines.

[44]  Philip Spinhoven,et al.  Childhood Trauma Questionnaire: factor structure, measurement invariance, and validity across emotional disorders. , 2014, Psychological assessment.

[45]  J. O'Loughlin,et al.  Measurement invariance of the depressive symptoms scale during adolescence , 2014, BMC Psychiatry.

[46]  F. Verhulst,et al.  The prevalence of DSM-III-R diagnoses in a national sample of Dutch adolescents. , 1997, Archives of general psychiatry.

[47]  D. Zimprich,et al.  Anger expression in Swiss adolescents: establishing measurement invariance across gender in the AX scales. , 2012, Journal of adolescence.

[48]  G. Riva,et al.  Italian version of the Dutch Eating Behavior Questionnaire. Psychometric proprieties and measurement invariance across sex, BMI-status and age , 2013, Appetite.

[49]  K. Kendler,et al.  Gender differences in the symptoms of major depression in opposite-sex dizygotic twin pairs. , 2002, The American journal of psychiatry.

[50]  W. Meredith Measurement invariance, factor analysis and factorial invariance , 1993 .

[51]  M. Carta,et al.  Confirmatory factor analysis and measurement invariance by gender, age and levels of psychological distress of the short TEMPS-A. , 2013, Journal of affective disorders.

[52]  D. Posthuma,et al.  Sex differences in adults' motivation to achieve , 2010 .

[53]  M. Rosén,et al.  Measuring social inequalities in health - politics or science? , 2003, Scandinavian journal of public health.

[54]  D. Kupfer,et al.  The effects of parental mood on reports of their children's psychopathology. , 2014, Journal of the American Academy of Child and Adolescent Psychiatry.

[55]  Ateka A. Contractor,et al.  Do gender and age moderate the symptom structure of PTSD? Findings from a national clinical sample of children and adolescents , 2013, Psychiatry Research.

[56]  C. Vlassoff Gender inequalities in health in the Third World: uncharted ground. , 1994, Social science & medicine.

[57]  Sven Bergmann,et al.  A higher mutational burden in females supports a "female protective model" in neurodevelopmental disorders. , 2014, American journal of human genetics.

[58]  René Veenstra,et al.  Evaluation of non-response bias in mental health determinants and outcomes in a large sample of pre-adolescents , 2005, European Journal of Epidemiology.

[59]  Kateryna V. Keefer,et al.  Longitudinal assessment of trait emotional intelligence: measurement invariance and construct continuity from late childhood to adolescence. , 2013, Psychological assessment.

[60]  J. Sergeant,et al.  Syndrome dimensions of the child behavior checklist and the teacher report form: a critical empirical evaluation. , 1999, Journal of child psychology and psychiatry, and allied disciplines.

[61]  S. Reise,et al.  Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. , 1997 .

[62]  M. Hautzinger [Sex differences in depression]. , 1991, Zeitschrift fur klinische Psychologie, Psychopathologie und Psychotherapie.

[63]  A. Sourander,et al.  Changes in psychiatric problems and service use among 8-year-old children: a 16-year population-based time-trend study. , 2008, Journal of the American Academy of Child and Adolescent Psychiatry.

[64]  S. Sandberg 4 Sex differences and their significance , 2002 .

[65]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[66]  Gideon J. Mellenbergh,et al.  Item bias and item response theory , 1989 .

[67]  L. Rescorla,et al.  International epidemiology of child and adolescent psychopathology ii: integration and applications of dimensional findings from 44 societies. , 2012, Journal of the American Academy of Child and Adolescent Psychiatry.

[68]  G. Wilkinson,et al.  Gender differences in depression. Critical review. , 2000, The British journal of psychiatry : the journal of mental science.

[69]  N. Krieger,et al.  Measuring social inequalities in health. Report on the Conference of the National Institutes of Health. , 1995, Public health reports.

[70]  K. Rice,et al.  Measurement Invariance and Latent Profiles of Perfectionism in Clients and Nonclients , 2019, Journal of counseling psychology.

[71]  Pei-Chen Wu Differential Functioning of the Chinese Version of Beck Depression Inventory-II in Adolescent Gender Groups: Use of a Multiple-Group Mean and Covariance Structure Model , 2010 .

[72]  Pei-Chen Wu Measurement Invariance and Latent Mean Differences of the Beck Depression Inventory II Across Gender Groups , 2010 .

[73]  S. Mednick,et al.  Measurement Invariance of Internalizing and Externalizing Behavioral Syndrome Factors in a Non-Western Sample , 2013, Assessment.

[74]  M. Underwood,et al.  Assessing peer victimization across adolescence: measurement invariance and developmental change. , 2013, Psychological assessment.

[75]  H. Meltzer,et al.  The British Child and Adolescent Mental Health Survey 1999: the prevalence of DSM-IV disorders. , 2003, Journal of the American Academy of Child and Adolescent Psychiatry.

[76]  L. Abramson,et al.  Development of gender differences in depression: an elaborated cognitive vulnerability-transactional stress theory. , 2001, Psychological bulletin.

[77]  A. Can,et al.  The Turkish Version of the Meaning in Life Questionnaire: Assessing the Measurement Invariance Across Turkish and American Adult Samples , 2013, Journal of personality assessment.