Concordance of the Composite International Diagnostic Interview Version 3.0 (CIDI 3.0) with standardized clinical assessments in the WHO World Mental Health Surveys

The DSM‐IV diagnoses generated by the fully structured lay‐administered Composite International Diagnostic Interview Version 3.0 (CIDI 3.0) in the WHO World Mental Health (WMH) surveys were compared to diagnoses based on follow‐up interviews with the clinician‐administered non‐patient edition of the Structured Clinical Interview for DSM‐IV (SCID) in probability subsamples of the WMH surveys in France, Italy, Spain, and the US. CIDI cases were oversampled. The clinical reappraisal samples were weighted to adjust for this oversampling. Separate samples were assessed for lifetime and 12‐month prevalence. Moderate to good individual‐level CIDI‐SCID concordance was found for lifetime prevalence estimates of most disorders. The area under the ROC curve (AUC, a measure of classification accuracy that is not influenced by disorder prevalence) was 0.76 for the dichotomous classification of having any of the lifetime DSM‐IV anxiety, mood and substance disorders assessed in the surveys and in the range 0.62–0.93 for individual disorders, with an inter‐quartile range (IQR) of 0.71–0.86. Concordance increased when CIDI symptom‐level data were added to predict SCID diagnoses in logistic regression equations. AUC for individual disorders in these equations was in the range 0.74–0.99, with an IQR of 0.87–0.96. CIDI lifetime prevalence estimates were generally conservative relative to SCID estimates. CIDI‐SCID concordance for 12‐month prevalence estimates could be studied powerfully only for two disorder classes, any anxiety disorder (AUC = 0.88) and any mood disorder (AUC = 0.83). As with lifetime prevalence, 12‐month concordance improved when CIDI symptom‐level data were added to predict SCID diagnoses. CIDI 12‐month prevalence estimates were unbiased relative to SCID estimates. The validity of the CIDI is likely to be under‐estimated in these comparisons due to the fact that the reliability of the SCID diagnoses, which is presumably less than perfect, sets a ceiling on maximum CIDI‐SCID concordance. Copyright © 2006 John Wiley & Sons, Ltd.

[1]  M. Weissman,et al.  Diagnostic interviewing for family studies: Comparing telephone and face-to-face methods for the diagnosis of lifetime psychiatric disorders , 1993 .

[2]  T. Brugha The end of the beginning: a requiem for the categorization of mental disorder? , 2002, Psychological Medicine.

[3]  R. Kessler,et al.  The prevalence and correlates of adult ADHD in the United States: results from the National Comorbidity Survey Replication. , 2006, The American journal of psychiatry.

[4]  Shekhar Saxena,et al.  On the development and psychometric testing of the WHO screening instrument to assess disablement in the general population , 1999 .

[5]  R. Kessler,et al.  Prevalence, severity, and unmet need for treatment of mental disorders in the World Health Organization World Mental Health Surveys. , 2004, JAMA.

[6]  K. Wolter Introduction to Variance Estimation , 1985 .

[7]  M. Prince,et al.  Validation of two survey diagnostic interviews among primary care attendees: a comparison of CIS-R and CIDI with SCAN ICD-10 diagnostic categories , 2004, Psychological Medicine.

[8]  P. Lewinsohn,et al.  Comparability of telephone and face-to-face interviews in assessing axis I and II disorders. , 1997, The American journal of psychiatry.

[9]  R. Kessler,et al.  Sampling and methods of the European Study of the Epidemiology of Mental Disorders (ESEMeD) project , 2004, Acta psychiatrica Scandinavica. Supplementum.

[10]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[11]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[12]  D. Rubin Multiple imputation for nonresponse in surveys , 1989 .

[13]  B. Grant,et al.  The co-occurrence of DSM-IV alcohol abuse in DSM-IV alcohol dependence: results of the National Epidemiologic Survey on Alcohol and Related Conditions on heterogeneity that differ by population subgroup. , 2004, Archives of general psychiatry.

[14]  R. Spitzer,et al.  Psychiatric diagnosis: are clinicians still necessary? , 1983, Comprehensive psychiatry.

[15]  H. Wittchen Reliability and validity studies of the WHO--Composite International Diagnostic Interview (CIDI): a critical review. , 1994, Journal of psychiatric research.

[16]  M Davies,et al.  The Structured Clinical Interview for DSM-III-R (SCID). II. Multisite test-retest reliability. , 1992 .

[17]  H. Tennen,et al.  Validity of the longitudinal, expert, all data procedure for psychiatric diagnosis in patients with psychoactive substance use disorders. , 1997, Drug and alcohol dependence.

[18]  M. Hersen,et al.  Reliability of the Structured Clinical Interview for DSM-III-R: an evaluative review. , 1994, Comprehensive Psychiatry.

[19]  Olga V. Demler,et al.  The Prevalence and Correlates of Nonaffective Psychosis in the National Comorbidity Survey Replication (NCS-R) , 2005, Biological Psychiatry.

[20]  A. Rush,et al.  The Inventory of Depressive Symptomatology (IDS): psychometric properties , 1996, Psychological Medicine.

[21]  J. Carlin,et al.  Bias, prevalence and kappa. , 1993, Journal of clinical epidemiology.

[22]  E. Spitznagel,et al.  A proposed solution to the base rate problem in the kappa statistic. , 1985, Archives of general psychiatry.

[23]  R. Kessler,et al.  Reliability and procedural validity of UM-CIDI DSM-III-R phobic disorders , 1996, Psychological Medicine.

[24]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[25]  T. B. Üstün,et al.  The World Mental Health (WMH) Survey Initiative version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI) , 2004, International journal of methods in psychiatric research.

[26]  N. Taub,et al.  A general population comparison of the Composite International Diagnostic Interview (CIDI) and the Schedules for Clinical Assessment in Neuropsychiatry (SCAN) , 2001, Psychological Medicine.

[27]  A. Agresti An introduction to categorical data analysis , 1997 .

[28]  T. Brugha,et al.  SCAN. Schedules for Clinical Assessment in Neuropsychiatry. , 1990, Archives of general psychiatry.

[29]  R. Kessler,et al.  DSM-IV Personality Disorders in the National Comorbidity Survey Replication , 2007, Biological Psychiatry.

[30]  Olga V. Demler,et al.  Clinical calibration of DSM‐IV diagnoses in the World Mental Health (WMH) version of the World Health Organization (WHO) Composite International Diagnostic Interview (WMH‐CIDI) , 2004, International journal of methods in psychiatric research.

[31]  M. Dew,et al.  Long-term reliability of diagnosing lifetime major depression in a community sample. , 1986, Archives of general psychiatry.

[32]  Olga V. Demler,et al.  The US National Comorbidity Survey Replication (NCS‐R): design and field procedures , 2004, International journal of methods in psychiatric research.

[33]  R. Kessler,et al.  Validity of the assessment of bipolar spectrum disorders in the WHO CIDI 3.0. , 2006, Journal of affective disorders.

[34]  Helena Chmura Kraemer,et al.  Measures of clinical significance. , 2003, Journal of the American Academy of Child and Adolescent Psychiatry.

[35]  R. Kessler,et al.  Methodological studies of the Composite International Diagnostic Interview (CIDI) in the US national comorbidity survey (NCS) , 1998 .

[36]  J. Endicott,et al.  Mastering the art of research interviewing. A model training procedure for diagnostic evaluation. , 1981, Archives of general psychiatry.

[37]  R. Kessler,et al.  A population-based twin study of major depression in women. The impact of varying definitions of illness. , 1992, Archives of general psychiatry.

[38]  D. Regier Community diagnosis counts. , 2000, Archives of general psychiatry.

[39]  G. Andrews,et al.  A Comparison of Two Structured Diagnostic Interviews: CIDI and SCAN , 1995, The Australian and New Zealand journal of psychiatry.

[40]  R. Kessler,et al.  Reliability and clinical validity of UM-CIDI DSM-III-R generalized anxiety disorder. , 1995, Journal of psychiatric research.

[41]  J. Kirchner,et al.  Diagnosing depression in the medically ill: validity of a lay-administered structured diagnostic interview. , 1998, Journal of psychiatric research.

[42]  Ronald C Kessler,et al.  The National Comorbidity Survey Replication (NCS‐R): background and aims , 2004, International journal of methods in psychiatric research.

[43]  M K Shear,et al.  Multicenter collaborative panic disorder severity scale. , 1997, The American journal of psychiatry.