Internet- vs. telephone-administered questionnaires in a randomized trial of smoking cessation.

The Internet offers a promising channel to conduct smoking cessation research. Among the advantages of Internet research are the ability to access large numbers of participants who might not otherwise participate in a cessation trial, and the ability to conduct research efficiently and cost-effectively. To leverage the opportunity of the Internet in clinical research, it is necessary to establish that measures of known validity used in research trials are reliable when administered via the Internet. To date, no published studies examine the psychometric properties of measures administered via the Internet to assess smoking variables and psychosocial constructs related to cessation (e.g., stress, social support, quit methods). The purpose of the present study was to examine the reliability of measures of previous quit methods, perceived stress, depression, social support for cessation, smoking temptations, alcohol use, perceived health status, and income when administered via the Internet. Participants in the present study were enrolled in a randomized controlled trial of the efficacy of Internet smoking cessation. Following baseline telephone assessment and randomization into the parent trial, participants were recruited to the reliability substudy. An email was sent 2 days after the telephone assessment with a link to the Internet survey and instructions to complete the survey that day. Of the 297 individuals invited to participate, 213 completed the survey within 1 week. Results indicate that the internal consistency and test-retest reliability of the measures examined are comparable when self-administered via the Internet or when interviewer-administered via telephone.

[1]  A Donner,et al.  Sample size requirements for the comparison of two or more coefficients of inter-observer agreement. , 1998, Statistics in medicine.

[2]  W F Velicer,et al.  Relapse situations and self-efficacy: an integrative model. , 1990, Addictive behaviors.

[3]  S. Gosling,et al.  Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires. , 2004, The American psychologist.

[4]  Jiun-Kae Jack Lee,et al.  A Better Confidence Interval for Kappa (κ) on Measuring Agreement between Two Raters with Binary Outcomes , 1994 .

[5]  K. McGraw,et al.  The Integrity of Web-Delivered Experiments: Can You Trust the Data? , 2000, Psychological science.

[6]  Kate Lorig,et al.  Internet Versus Mailed Questionnaires: A Randomized Comparison , 2004, Journal of medical Internet research.

[7]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[8]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[9]  L. Kozlowski,et al.  The Fagerström Test for Nicotine Dependence: a revision of the Fagerström Tolerance Questionnaire. , 1991, British journal of addiction.

[10]  Sheldon Cohen,et al.  Partner behaviors that support quitting smoking. , 1990, Journal of consulting and clinical psychology.

[11]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[12]  S. Shiffman,et al.  Progression from a smoking lapse to relapse: prediction from abstinence violation effects, nicotine dependence, and lapse characteristics. , 1996, Journal of consulting and clinical psychology.

[13]  H. Neudecker,et al.  On the distribution of the maximum likelihood estimator of Cronbach's alpha , 2000 .

[14]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[15]  R. Mermelstein,et al.  Partner support and relapse in smoking-cessation programs. , 1983, Journal of consulting and clinical psychology.

[16]  K. Fagerström,et al.  Nicotine dependence versus smoking prevalence: comparisons among countries and categories of smokers. , 1996, Tobacco control.

[17]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[18]  B. Everitt,et al.  Large sample standard errors of kappa and weighted kappa. , 1969 .

[19]  Partner Support and Other Determinants of Smoking Cessation Maintenance among Women. , 1985 .

[20]  Samuel D Gosling,et al.  Global self-esteem across the life span. , 2002, Psychology and aging.

[21]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[22]  T. Kamarck,et al.  A global measure of perceived stress. , 1983, Journal of health and social behavior.

[23]  K. Cummings,et al.  Debunking myths about self-quitting. Evidence from 10 prospective studies of persons who attempt to quit smoking by themselves. , 1989, The American psychologist.

[24]  D L Patrick,et al.  Screening for depression in well older adults: evaluation of a short form of the CES-D (Center for Epidemiologic Studies Depression Scale). , 1994, American journal of preventive medicine.

[25]  John L. Smith,et al.  Using the Internet for psychological research: personality testing on the World Wide Web. , 1999, British journal of psychology.

[26]  D. Wetter,et al.  The relation between alcohol consumption and smoking abstinence: results from the Working Well Trial. , 2002, Addictive behaviors.

[27]  D A Asch,et al.  Response rates to mail surveys published in medical journals. , 1997, Journal of clinical epidemiology.

[28]  Sheldon Cohen Perceived stress in a probability sample of the United States , 1988 .

[29]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[30]  R. N. Davis,et al.  Web-based administration of a personality questionnaire: Comparison with traditional methods , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[31]  H. Lando,et al.  Long-term associations of helpful and harmful spousal behaviors with smoking cessation. , 1996, Addictive behaviors.

[32]  D. Hedeker,et al.  Effects of social support and relapse prevention training as adjuncts to a televised smoking-cessation intervention. , 1993, Journal of consulting and clinical psychology.

[33]  R L Brown,et al.  A two-item conjoint screen for alcohol and other drug problems. , 2001, The Journal of the American Board of Family Practice.

[34]  Yu-Chuan Li,et al.  The validity of an Internet-based Self-assessment Program for Depression , 2003, AMIA.

[35]  P. Remington,et al.  Depression and the dynamics of smoking. A national perspective. , 1990, JAMA.

[36]  L. Jason,et al.  Social Support in a Worksite Smoking Intervention , 2000, Behavior modification.

[37]  W. Keith Campbell,et al.  Individual differences in narcissism: Inflated self-views across the lifespan and around the world , 2003 .