The Interview Mode Effect on the Center for Epidemiological Studies Depression (CES-D) Scale: An Item Response Theory Analysis

BackgroundEvidence of a mode effect has raised concerns about the comparability and validity of self- versus interviewer-administered versions of the Center for Epidemiological Studies Depression (CES-D) scale. Response anonymity has been proposed to explain this effect. However, the factors that contribute to this mode effect are not well understood. We used item response theory (IRT) to examine the nature of the CES-D mode effect. MethodsA sample of depressed primary care patients from the Partners-in-Care Study were randomized to receive either a phone interview (N = 139) or a mail survey (N = 139) of the CES-D. We used likelihood ratio tests to identify differentially functioning items in the 2 groups. Category response curves are used to describe these effects. ResultsTwelve items manifested differential functioning. Category response curves consistently indicate that phone respondents had a lower probability of endorsing the third of 4 response categories than mail respondents, suggesting a possible cognitive effect. ConclusionAlthough response anonymity could be important in mode effects observed in surveys of sensitive topics, cognitive factors appear more important to the mode effect in the CES-D.

[1]  I. Niedhammer,et al.  Psychosocial factors at work, personality traits and depressive symptoms , 2002, British Journal of Psychiatry.

[2]  Laurie F. Beck,et al.  Prevalence of selected maternal behaviors and experiences, Pregnancy Risk Assessment Monitoring System (PRAMS), 1999. , 2002, Morbidity and mortality weekly report. Surveillance summaries.

[3]  Alan M. Zaslavsky,et al.  Using Telephone Interviews to Reduce Nonresponse Bias to Mail Surveys of Health Plan Members , 2002, Medical care.

[4]  M. Orlando,et al.  Differential item functioning in a Spanish translation of the PTSD checklist: detection and evaluation of impact. , 2002, Psychological assessment.

[5]  C. Sherbourne,et al.  The Quality Improvement for Depression collaboration: general analytic strategies for a coordinated study of quality improvement in depression care. , 2001, General hospital psychiatry.

[6]  Robert Cameron Mitchell,et al.  The Impact of "No Opinion" Response Options on Data Quality: Non-Attitude Reduction or an Invitation to Satisfice? , 2001 .

[7]  T. Oltmanns,et al.  Psychometric Analysis of Racial Differences on the Maudsley Obsessional Compulsive Inventory , 2000, Assessment.

[8]  J. Teresi,et al.  Modern psychometric methods for detection of differential item functioning: application to cognitive assessment measures. , 2000, Statistics in medicine.

[9]  M. Moeschberger,et al.  Depression as an antecedent to heart disease among women and men in the NHANES I study. National Health and Nutrition Examination Survey. , 2000, Archives of internal medicine.

[10]  S. Reise,et al.  Evaluating the equivalence of health care ratings by whites and Hispanics. , 2000, Medical care.

[11]  B. Reed,et al.  Development of psychometrically matched English and Spanish language neuropsychological tests for older persons. , 2000, Neuropsychology.

[12]  C. Sherbourne,et al.  Impact of disseminating quality improvement programs for depression in managed primary care: a randomized controlled trial. , 2000, JAMA.

[13]  C. Sherbourne,et al.  Summed-score linking using item response theory: application to depression measurement. , 2000, Psychological assessment.

[14]  K. Wells,et al.  Quality of care for primary care patients with depression in managed care. , 1999, Archives of family medicine.

[15]  A. Beekman,et al.  The Center for Epidemiologic Studies Depression scale (CES‐D) in a mixed‐mode repeated measurements design: sex and age effects in older adults , 1999 .

[16]  T. Coates,et al.  Mode effects in surveys of gay men: A within‐individual comparison of responses by mail and by telephone , 1999 .

[17]  D. Karus,et al.  Correlates of depressive symptomatology among adult daughter caregivers of a parent with cancer , 1998, Cancer.

[18]  W. Aquilino.  INTERVIEW MODE EFFECTS IN SURVEYS OF DRUG AND ALCOHOL USE: A FIELD EXPERIMENT , 1994 .

[19]  C. McHorney,et al.  Comparisons of the Costs and Quality of Norms for the SF-36 Health Survey Collected by Mail Versus Telephone Interview: Results From a National Survey , 1994, Medical care.

[20]  L. Berkman,et al.  Two Shorter Forms of the CES-D Depression Symptoms Index , 1993 .

[21]  Howard Wainer,et al.  Detection of differential item functioning using the parameters of item response models. , 1993 .

[22]  Judith T. Lessler,et al.  Effects of mode of administration and wording on reporting of drug use; DHHS Pub. No. (ADM) 92-1929; Technical paper 8 , 1991 .

[23]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[24]  D. Dillman.  The Design and Administration of Mail Surveys , 1991 .

[25]  T. Garrity,et al.  Prevalence and correlates of depressive symptoms among older U.S. adults. , 1990, American journal of preventive medicine.

[26]  J. Krosnick,et al.  AN EVALUATION OF A COGNITIVE THEORY OF RESPONSE-ORDER EFFECTS IN SURVEY MEASUREMENT , 1987 .

[27]  P. Kline.  Models of man , 1986, Nature.

[28]  P. V. Marsden,et al.  Handbook of Survey Research , 1985 .

[29]  L. Radloff.  The CES-D Scale , 1977 .

[30]  F. Samejima.  Estimation of latent ability using a response pattern of graded scores , 1968 .

[31]  J. R. Hochstim.  A Critical Comparison of Three Strategies of Collecting Data from Households , 1967 .