Development of a Computer-adaptive Test for Depression (D-CAT)

Depression is one of the most prevalent mental health problems and measuring depressive symptoms becomes increasingly important in science as well as medical practice. Computer Adaptive Tests (CAT) based on the Item Response Theory (IRT) promise to enhance measurement precision and reduce respondent’s burden. Our aim was to develop a CAT application to measure depressive symptoms. Three thousand two hundred seventy psychosomatic patients answered an overall of 11 mental health questionnaires at the University Clinic in Berlin. Three independent reviewers rated 144 items out of these questionnaires as indicative of depressive symptoms. All items underwent six empirical steps to analyze unidimensionality, local independence and item discrimination. Finally 64 items could be used to calculate item parameters applying a Generalized Partial Credit Model (GPCM). CAT scores were estimated using an ‘expected a posteriori’ algorithm (EAP). Two simulation experiments showed that for theta values within the range of 2SD around the mean (98% of the cases), the latent trait can be estimated out of approximately six items with a predefined standard error of ⩽ 0.32 (reliability ρ ⩾ 0.90). The CAT-scores correlated high with scores of all depression items (r = 0.95), with the Beck Depression Inventory (r = 0.79) and with a CES-D 8 item short form (r = 0.76). We conclude that the Depression-CAT measures depressive symptoms with high precision and low respondent burden.

[1]  M. Reckase.  Unifactor Latent Trait Models Applied to Multifactor Tests: Results and Implications , 1979 .

[2]  R. Sitgreaves.  Psychometric theory (2nd ed.). , 1979 .

[3]  R. D. Bock,et al.  Adaptive EAP Estimation of Ability in a Microcomputer Environment , 1982 .

[4]  C. Parsons,et al.  Application of Unidimensional Item Response Theory Models to Multidimensional Data , 1983 .

[5]  B. Wright,et al.  The essential process in a family of measurement models , 1984 .

[6]  E. Muraki,et al.  Full-Information Item Factor Analysis , 1988 .

[7]  R. P. McDonald,et al.  Future directions for item response theory , 1989 .

[8]  D. D. Bickerstaff,et al.  Computerized adaptive testing , 2015 .

[9]  C. Attkisson,et al.  Depression in primary care : screening and detection , 1990 .

[10]  W. Katon,et al.  Depression and chronic medical illness. , 1990, The Journal of clinical psychiatry.

[11]  H. Swaminathan,et al.  Detecting Differential Item Functioning Using Logistic Regression Procedures , 1990 .

[12]  N. Nagelkerke,et al.  A note on a general definition of the coefficient of determination , 1991 .

[13]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[14]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[15]  E. Muraki.  A GENERALIZED PARTIAL CREDIT MODEL: APPLICATION OF AN EM ALGORITHM , 1992 .

[16]  T. Moum,et al.  How well can a few questionnaire items indicate anxiety and depression? , 1993, Acta psychiatrica Scandinavica.

[17]  H. Wainer,et al.  Differential Item Functioning. , 1994 .

[18]  R. MacCallum,et al.  Power analysis and determination of sample size for covariance structure modeling. , 1996 .

[19]  E. Muraki.  A Generalized Partial Credit Model , 1997 .

[20]  D. Cooke,et al.  An Item Response Theory Analysis of the Hare Psychopathy Checklist-Revised , 1997 .

[21]  R. Hambleton,et al.  Handbook of Modern Item Response Theory , 1997 .

[22]  Research antecedents of applied adaptive testing. , 1997 .

[23]  William A. Sands,et al.  Computerized adaptive testing: From inquiry to operation. , 1997 .

[24]  Monika Bullinger,et al.  SF-36, Fragebogen zum Gesundheitszustand , 1998 .

[25]  H. Fliege,et al.  [Questionnaire of self-efficacy, optimism and pessimism: reconstruction, selection of items and validation of an instrument by means of examinations of clinical samples]. , 1999, Psychotherapie, Psychosomatik, medizinische Psychologie.

[26]  R. Kessler,et al.  Development of a Brief Screening Instrument: The HANDS , 1999, Psychotherapy and Psychosomatics.

[27]  L. F. Hornke.  Benefits from Computerized Adaptive Testing as Seen in Simulation Studies , 1999 .

[28]  [Mobile computer-assisted psychometric diagnosis. Economic advantages and results on test stability]. , 1999, Psychotherapie, Psychosomatik, medizinische Psychologie.

[29]  B. Zumbo.  A Handbook on the Theory and Methods of Differential Item Functioning (DIF) LOGISTIC REGRESSION MODELING AS A UNITARY FRAMEWORK FOR BINARY AND LIKERT-TYPE (ORDINAL) ITEM SCORES , 1999 .

[30]  Rob R. Meijer,et al.  Computerized Adaptive Testing: Overview and Introduction , 1999 .

[31]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[32]  Computerized adaptive assessment with the MMPI-2 in a clinical setting. , 1999 .

[33]  [Narcissism inventory-90 (NI-90). Empirically-based reduction and identification of items sensitive for change--a questionnaire particularly suited for measuring self-regulatory parameters]. , 2000, Psychotherapie, Psychosomatik, medizinische Psychologie.

[34]  J. Ware,et al.  Practical implications of item response theory and computerized adaptive testing: a brief summary of ongoing studies of widely used headache impact scales. , 2000, Medical care.

[35]  C. Sherbourne,et al.  Summed-score linking using item response theory: application to depression measurement. , 2000, Psychological assessment.

[36]  E. Bradley,et al.  Health effects of involuntary job loss among older workers: findings from the health and retirement survey. , 2000, The journals of gerontology. Series B, Psychological sciences and social sciences.

[37]  S. Embretson,et al.  Item response theory for psychologists , 2000 .

[38]  A. Panter,et al.  Item Response Theory in Personality Assessment: A Demonstration using the MMPI-2 Depression Scale , 2000, Assessment.

[39]  Narzissmusinventar-90 (NI-90) - Empiriegeleitete Itemreduktion und Identifikation veränderungssensitiver Items des Narzissmusinventars zur Messung selbstregulativer Parameter1 - , 2000 .

[40]  D. Cella,et al.  Response to Hays et al and McHorney and Cohen: A Discussion of Item Response Theory and Its Applications in Health Status Assessment , 2000, Medical care.

[41]  J. Coyne,et al.  Examining symptom expression as a function of symptom severity: item performance on the Hamilton Rating Scale for Depression. , 2001, Psychological assessment.

[42]  T A Sheldon,et al.  Routinely administered questionnaires for depression and anxiety: systematic review , 2001, BMJ : British Medical Journal.

[43]  P Bech,et al.  The sensitivity and specificity of the Major Depression Inventory, using the Present State Examination as the index of diagnostic validity. , 2001, Journal of affective disorders.

[44]  H. Fliege,et al.  Prädiktoren des Behandlungsergebnisses stationärer psychosomatischer Therapie , 2002 .

[45]  Der Fragebogen Alltagsleben: Restrukturierung und klinische Validierung , 2002 .

[46]  W. Gardner,et al.  Multidimensional Adaptive Testing for Mental Health Problems in Primary Care , 2002, Medical care.

[47]  Paul Ciechanowski,et al.  Impact of major depression on chronic medical illness. , 2002, Journal of psychosomatic research.

[48]  B. Burns,et al.  DEPRESSION AND HEALTH-RELATED QUALITY OF LIFE , 2002, The Journal of nervous and mental disease.

[49]  MMPI-2 short form proposal: CAUTION. , 2003, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[50]  Development of a Short Form for the MMPI-2 Based on Scale Elevation Congruence , 2003, Assessment.

[51]  P. Bech,et al.  The internal and external validity of the Major Depression Inventory in measuring severity of depressive states , 2003, Psychological Medicine.

[52]  R. Hu.  Diagnostic and Statistical Manual of Mental Disorders (DSM-IV) , 2003 .

[53]  Daniel J Buysse,et al.  Computerized adaptive measurement of depression: A simulation study , 2004, BMC psychiatry.

[54]  Jakob B. Bjorner,et al.  The feasibility of applying item response theory to measures of migraine impact: A re-analysis of three clinical studies , 2003, Quality of Life Research.

[55]  Maria Orlando,et al.  The Interview Mode Effect on the Center for Epidemiological Studies Depression (CES-D) Scale: An Item Response Theory Analysis , 2004, Medical care.

[56]  M. Kosinski,et al.  Calibration of an item pool for assessing the burden of headaches: An application of item response theory to the Headache Impact Test (HIT™) , 2003, Quality of Life Research.