Survey conditioning in self-reported mental health service use: randomized comparison of alternative instrument formats.

OBJECTIVE To test the effect of survey conditioning (whether observed survey responses are affected by previous experience in the same survey or similar surveys) in a survey instrument used to assess mental health service use. DATA SOURCES Primary data collected in the National Latino and Asian American Study, a cross-sectional household survey of Latinos and Asian Americans residing in the United States. STUDY DESIGN Study participants are randomly assigned to a Traditional Instrument with an interleafed format placing service use questions after detailed questions on disorders, or a Modified Instrument with an ensemble format screening for service use near the beginning of the survey. We hypothesize the ensemble format to be less susceptible to survey conditioning than the interleafed format. We compare self-reported mental health services use measures (overall, aggregate categories, and specific categories) between recipients of the two instruments, using 2x2 chi(2) tests and logistic regressions that control for key covariates. DATA COLLECTION In-person computer-assisted interviews, conducted in respondent's preferred language (English, Spanish, Mandarin Chinese, Tagalog, or Vietnamese). PRINCIPAL FINDINGS Higher service use rates are reported with the Modified Instrument than with the Traditional Instrument for all service use measures; odds ratios range from 1.41 to 3.10, all p-values <.001. Results are similar across ethnic groups and insensitive to model specification. CONCLUSIONS Survey conditioning biases downward reported mental health service use when the instrument follows an interleafed format. An ensemble format should be used when it is feasible for measures that are susceptible to survey conditioning.

[1]  Bogomir Mršulja,et al.  Guest editorial , 2005, Metabolic Brain Disease.

[2]  Xiao-Li Meng,et al.  Considering context, place and culture: the National Latino and Asian American Study , 2004, International journal of methods in psychiatric research.

[3]  David R. Williams,et al.  The National Survey of American Life: a study of racial, ethnic and cultural influences on mental disorders and mental health , 2004, International journal of methods in psychiatric research.

[4]  N. Duan,et al.  Sample designs and sampling methods for the Collaborative Psychiatric Epidemiology Studies (CPES) , 2004, International journal of methods in psychiatric research.

[5]  Ronald C Kessler,et al.  The National Comorbidity Survey Replication (NCS‐R): background and aims , 2004, International journal of methods in psychiatric research.

[6]  T. B. Üstün,et al.  The World Mental Health (WMH) Survey Initiative version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI) , 2004, International journal of methods in psychiatric research.

[7]  Steven G. Pennell,et al.  PANEL CONDITIONING EFFECTS IN THE SURVEY OF INCOME AND PROGRAM PARTICIPATION , 2002 .

[8]  M. Gabe Mental health: a report of the Surgeon General. , 2000, Home care provider.

[9]  David E. Booth,et al.  Analysis of Incomplete Multivariate Data , 2000, Technometrics.

[10]  R. Kessler,et al.  Methodological issues in assessing psychiatric disorders with self-reports. , 2000 .

[11]  M. Rubio‐Stipec,et al.  Informant-Based Determinants of Symptom Attenuation in Structured Child Psychiatric Interviews , 1999, Journal of abnormal child psychology.

[12]  P. Jensen,et al.  Who's Up First? Testing for Order Effects in Structured Interviews Using a Counterbalanced Experimental Design , 1999, Journal of abnormal child psychology.

[13]  G. Canino,et al.  Features of Interview Questions Associated with Attenuation of Symptom Reports , 1999, Journal of abnormal child psychology.

[14]  D. Blazer,et al.  Design Issues in the Gulf War Veterans Health Study , 1999 .

[15]  J. Caraveo-Anduaga,et al.  Lifetime prevalence of DSM-III-R psychiatric disorders among urban and rural Mexican Americans in California. , 1998, Archives of general psychiatry.

[16]  R. Kessler,et al.  Methodological studies of the Composite International Diagnostic Interview (CIDI) in the US national comorbidity survey (NCS) , 1998 .

[17]  C. Vázquez,et al.  Lifetime and 12‐month prevalence of DSM‐III‐R mental disorders among the homeless in Madrid: a European study using the CIDI , 1997, Acta psychiatrica Scandinavica.

[18]  E. S. Knowles,et al.  Measurement-induced improvement in anxiety: mean shifts with repeated assessment. , 1996, Journal of personality and social psychology.

[19]  G. Canino,et al.  Test-retest reliability of the Diagnostic Interview Schedule for Children (DISC 2.1). Parent, child, and combined algorithms. , 1995, Archives of general psychiatry.

[20]  R. Kessler,et al.  Lifetime and 12-month prevalence of DSM-III-R psychiatric disorders in the United States. Results from the National Comorbidity Survey. , 1994, Archives of general psychiatry.

[21]  Thomas G. Whiston,et al.  A National Survey , 1992 .

[22]  L. Robins,et al.  National Institute of Mental Health Diagnostic Interview Schedule. Its history, characteristics, and validity. , 1981, Archives of general psychiatry.

[23]  Barbara A. Bailar,et al.  The Effects of Rotation Group Bias on Estimates from Panel Surveys , 1975 .