National comorbidity survey replication adolescent supplement (NCS-A): III. Concordance of DSM-IV/CIDI diagnoses with clinical reassessments.

OBJECTIVE To report results of the clinical reappraisal study of lifetime DSM-IV diagnoses based on the fully structured lay-administered World Health Organization Composite International Diagnostic Interview (CIDI) Version 3.0 in the U.S. National Comorbidity Survey Replication Adolescent Supplement (NCS-A). METHOD Blinded clinical reappraisal interviews with a probability subsample of 347 NCS-A respondents were administered using the Schedule for Affective Disorders and Schizophrenia for School-Age Children (K-SADS) as the gold standard. The DSM-IV/CIDI cases were oversampled, and the clinical reappraisal sample was weighted to adjust for this oversampling. RESULTS Good aggregate consistency was found between CIDI and K-SADS prevalence estimates, although CIDI estimates were meaningfully higher than K-SADS estimates for specific phobia (51.2%) and oppositional defiant disorder (38.7%). Estimated prevalence of any disorder, in comparison, was only slightly higher in the CIDI than K-SADS (8.3%). Strong individual-level CIDI versus K-SADS concordance was found for most diagnoses. Area under the receiver operating characteristic curve, a measure of classification accuracy not influenced by prevalence, was 0.88 for any anxiety disorder, 0.89 for any mood disorder, 0.84 for any disruptive behavior disorder, 0.94 for any substance disorder, and 0.87 for any disorder. Although area under the receiver operating characteristic curve was unacceptably low for alcohol dependence and bipolar I and II disorders, these problems were resolved by aggregation with alcohol abuse and bipolar I disorder, respectively. Logistic regression analysis documented that consideration of CIDI symptom-level data significantly improved prediction of some K-SADS diagnoses. CONCLUSIONS These results document that the diagnoses made in the NCS-A based on the CIDI have generally good concordance with blinded clinical diagnoses.

[1]  Olga V. Demler,et al.  Clinical calibration of DSM‐IV diagnoses in the World Mental Health (WMH) version of the World Health Organization (WHO) Composite International Diagnostic Interview (WMH‐CIDI) , 2004, International journal of methods in psychiatric research.

[2]  M. Dew,et al.  Long-term reliability of diagnosing lifetime major depression in a community sample. , 1986, Archives of general psychiatry.

[3]  P. Houck,et al.  Reliability of the self‐report version of the panic disorder severity scale , 2002, Depression and anxiety.

[4]  P. Lewinsohn,et al.  Comparability of telephone and face-to-face interviews in assessing axis I and II disorders. , 1997, The American journal of psychiatry.

[5]  Helena Chmura Kraemer,et al.  Measures of clinical significance. , 2003, Journal of the American Academy of Child and Adolescent Psychiatry.

[6]  T. DeMaio,et al.  Do Different Cognitive Interview Techniques Produce Different Results , 2004 .

[7]  R R Frerichs,et al.  Measuring depression in the community: a comparison of telephone and personal interviews. , 1982, Public opinion quarterly.

[8]  R. Kessler,et al.  Methodological studies of the Composite International Diagnostic Interview (CIDI) in the US national comorbidity survey (NCS) , 1998 .

[9]  Ronald C Kessler,et al.  National comorbidity survey replication adolescent supplement (NCS-A): II. Overview and design. , 2009, Journal of the American Academy of Child and Adolescent Psychiatry.

[10]  D. Rubin.  The Bayesian Bootstrap , 1981 .

[11]  E J Costello,et al.  Validity of the NIMH Diagnostic Interview Schedule for Children: A comparison between psychiatric and pediatric referrals , 1985, Journal of abnormal child psychology.

[12]  M. Weissman,et al.  Diagnostic interviewing for family studies: Comparing telephone and face-to-face methods for the diagnosis of lifetime psychiatric disorders , 1993 .

[13]  P. Jensen,et al.  Who's Up First? Testing for Order Effects in Structured Interviews Using a Counterbalanced Experimental Design , 1999, Journal of abnormal child psychology.

[14]  R. Kessler,et al.  The prevalence and correlates of adult ADHD in the United States: results from the National Comorbidity Survey Replication. , 2006, The American journal of psychiatry.

[15]  Shekhar Saxena,et al.  On the development and psychometric testing of the WHO screening instrument to assess disablement in the general population , 1999 .

[16]  M K Shear,et al.  Multicenter collaborative panic disorder severity scale. , 1997, The American journal of psychiatry.

[17]  G. Willis,et al.  Cognitive Interviewing: A Tool for Improving Questionnaire Design , 2004 .

[18]  A. Agresti.  An introduction to categorical data analysis , 1997 .

[19]  Fausto Mazzi,et al.  Concordance of the Composite International Diagnostic Interview Version 3.0 (CIDI 3.0) with standardized clinical assessments in the WHO World Mental Health Surveys , 2006, International journal of methods in psychiatric research.

[20]  T. Brugha,et al.  SCAN. Schedules for Clinical Assessment in Neuropsychiatry. , 1990, Archives of general psychiatry.

[21]  K. Wolter.  Introduction to Variance Estimation , 1985 .

[22]  V. Patel,et al.  Medical decision making: a selective review for child psychiatrists and psychologists. , 2005, Journal of child psychology and psychiatry, and allied disciplines.

[23]  M. Prince,et al.  Validation of two survey diagnostic interviews among primary care attendees: a comparison of CIS-R and CIDI with SCAN ICD-10 diagnostic categories , 2004, Psychological Medicine.

[24]  R. Hough,et al.  Comparing DISC-IV and clinician diagnoses among youths receiving public mental health services. , 2003, Journal of the American Academy of Child and Adolescent Psychiatry.

[25]  A. Rush,et al.  The Inventory of Depressive Symptomatology (IDS): psychometric properties , 1996, Psychological Medicine.

[26]  J. Carlin,et al.  Bias, prevalence and kappa. , 1993, Journal of clinical epidemiology.

[27]  E. Spitznagel,et al.  A proposed solution to the base rate problem in the kappa statistic. , 1985, Archives of general psychiatry.

[28]  W. Reich,et al.  Reliability, validity, and parent-child agreement studies of the Diagnostic Interview for Children and Adolescents (DICA). , 1987, Journal of the American Academy of Child and Adolescent Psychiatry.

[29]  P. Ambrosini.  Historical development and present status of the schedule for affective disorders and schizophrenia for school-age children (K-SADS). , 2000, Journal of the American Academy of Child and Adolescent Psychiatry.

[30]  R. Kessler,et al.  DSM-IV Personality Disorders in the National Comorbidity Survey Replication , 2007, Biological Psychiatry.

[31]  M. Weissman,et al.  Best estimate of lifetime psychiatric diagnosis: a methodological study. , 1982, Archives of general psychiatry.

[32]  R. Kessler,et al.  National comorbidity survey replication adolescent supplement (NCS-A): I. Background and measures. , 2009, Journal of the American Academy of Child and Adolescent Psychiatry.

[33]  J. Losilla,et al.  Diagnostic agreement between clinicians and the Diagnostic Interview for Children and Adolescents--DICA-R--in an outpatient sample. , 1997, Journal of child psychology and psychiatry, and allied disciplines.

[34]  G. Canino,et al.  Criterion validity of the NIMH Diagnostic Interview Schedule for Children Version 2.3 (DISC-2.3). , 1996, Journal of the American Academy of Child and Adolescent Psychiatry.

[35]  H. Tennen,et al.  Validity of the longitudinal, expert, all data procedure for psychiatric diagnosis in patients with psychoactive substance use disorders. , 1997, Drug and alcohol dependence.

[36]  E J Costello,et al.  The Child and Adolescent Psychiatric Assessment (CAPA) , 1995, Psychological Medicine.

[37]  T. Brugha.  The end of the beginning: a requiem for the categorization of mental disorder? , 2002, Psychological Medicine.

[38]  E. Simonoff,et al.  The Child and Adolescent Psychiatric Assessment (CAPA). , 1995, Psychological medicine.

[39]  C. Johnston,et al.  Incremental validity in the psychological assessment of children and adolescents. , 2003, Psychological assessment.

[40]  B. Grant,et al.  The co-occurrence of DSM-IV alcohol abuse in DSM-IV alcohol dependence: results of the National Epidemiologic Survey on Alcohol and Related Conditions on heterogeneity that differ by population subgroup. , 2004, Archives of general psychiatry.

[41]  C. Lucas,et al.  Comparing the Validity of Clinician-Generated Diagnosis of Conduct Disorder to the Diagnostic Interview Schedule for Children , 2004, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[42]  P. Szatmari,et al.  Evaluation of the diagnostic interview for children and adolescents for use in general population samples , 1993, Journal of abnormal child psychology.

[43]  Olga V. Demler,et al.  The Prevalence and Correlates of Nonaffective Psychosis in the National Comorbidity Survey Replication (NCS-R) , 2005, Biological Psychiatry.

[44]  R. Kessler,et al.  Reliability and procedural validity of UM-CIDI DSM-III-R phobic disorders , 1996, Psychological Medicine.

[45]  Ronald C Kessler,et al.  Design and field procedures in the US National Comorbidity Survey Replication Adolescent Supplement (NCS‐A) , 2009, International journal of methods in psychiatric research.

[46]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[47]  D. Rubin.  Multiple imputation for nonresponse in surveys , 1989 .

[48]  T. Ollendick,et al.  Issues in Parent-Child Agreement: The Case of Structured Diagnostic Interviews , 2002, Clinical child and family psychology review.

[49]  G. Andrews,et al.  A Comparison of Two Structured Diagnostic Interviews: CIDI and SCAN , 1995, The Australian and New Zealand journal of psychiatry.

[50]  D. Regier,et al.  Revised prevalence estimates of mental disorders in the United States: using a clinical significance criterion to reconcile 2 surveys' estimates. , 2002, Archives of general psychiatry.

[51]  R. Kessler,et al.  Reliability and clinical validity of UM-CIDI DSM-III-R generalized anxiety disorder. , 1995, Journal of psychiatric research.

[52]  J. Markowitz,et al.  The 16-Item quick inventory of depressive symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression , 2003, Biological Psychiatry.

[53]  H. Wittchen.  Reliability and validity studies of the WHO--Composite International Diagnostic Interview (CIDI): a critical review. , 1994, Journal of psychiatric research.

[54]  R. Kessler,et al.  A population-based twin study of major depression in women. The impact of varying definitions of illness. , 1992, Archives of general psychiatry.

[55]  D. Regier.  Community diagnosis counts. , 2000, Archives of general psychiatry.

[56]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[57]  R. Spitzer,et al.  Psychiatric diagnosis: are clinicians still necessary? , 1983, Comprehensive psychiatry.

[58]  T. B. Üstün,et al.  The World Mental Health (WMH) Survey Initiative version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI) , 2004, International journal of methods in psychiatric research.

[59]  N. Taub,et al.  A general population comparison of the Composite International Diagnostic Interview (CIDI) and the Schedules for Clinical Assessment in Neuropsychiatry (SCAN) , 2001, Psychological Medicine.

[60]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[61]  J. Kirchner,et al.  Diagnosing depression in the medically ill: validity of a lay-administered structured diagnostic interview. , 1998, Journal of psychiatric research.

[62]  N. Ryan,et al.  Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): initial reliability and validity data. , 1997, Journal of the American Academy of Child and Adolescent Psychiatry.

[63]  Ronald C Kessler,et al.  The National Comorbidity Survey Replication (NCS‐R): background and aims , 2004, International journal of methods in psychiatric research.