The impact of computer versus paper-pencil survey, and individual versus group administration, on self-reports of sensitive behaviors

The purpose of this study was to clarify the strengths and weaknesses of both computer based and paper-pencil methods of sensitive data collection in various administrative settings. A total of 180 students signed-up for optional course-credit and were randomly assigned to complete a questionnaire using either a paper-pencil, or a computer based method, and in one of the following administration settings: group, alone in a designated office, or being emailed/mailed the information and filling it out when/where they pleased. Results show that perceptions of anonymity and confidentiality were strongly correlated with self-reported accuracy. However, although perceptions of anonymity and confidentiality differed by condition, this had no statistically significant impact on responses. Though perceptions of anonymity and confidentiality differ between methods, neither method appears to be superior in the context of overall response bias.

[1]  Joshua R. Smith,et al.  The Doctrine and Covenants of the Church of Jesus Christ of Latter-day Saints : containing the revelations given to Joseph Smith, the prophet, with some additions by his successors in the presidency of the Church , 1950 .

[2]  James A. Hall,et al.  A Comparison of Computer-Based Versus Pencil-and-Paper Assessment of Drug Use , 2002 .

[3]  Roland S. Moore,et al.  Survey confidentiality vs anonymity: Young men's self-reported substance use. , 2002 .

[4]  Kypros Kypri,et al.  An internet-based survey method for college student drinking research. , 2004, Drug and alcohol dependence.

[5]  Laura Kann,et al.  Reliability of the 1999 youth risk behavior survey questionnaire. , 2002, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[6]  S. M. Rogers,et al.  Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. , 1998, Science.

[7]  L. Kann,et al.  The Youth Risk Behavior Surveillance System: measuring health-risk behaviors. , 2001, American journal of health behavior.

[8]  David DiLillo,et al.  Participant Responses to Retrospective Surveys of Child Maltreatment: Does Mode of Assessment Matter? , 2006, Violence and Victims.

[9]  Martyn Denscombe,et al.  Web-Based Questionnaires and the Mode Effect , 2006 .

[10]  R. Catalano,et al.  Risk and protective factors for alcohol and other drug problems in adolescence and early adulthood: implications for substance abuse prevention. , 1992, Psychological bulletin.

[11]  Tom W. Smith,et al.  ASKING SENSITIVE QUESTIONS THE IMPACT OF DATA COLLECTION MODE, QUESTION FORMAT, AND QUESTION CONTEXT , 1996 .

[12]  D. L. Mitchell.  A multivariate analysis of the effects of gender and computer vs paper/pencil modes of administration on survey results , 1993 .

[13]  Fritz Drasgow,et al.  A Meta-Analytic Study of Social Desirability Distortion in Computer- Administered Questionnaires, Traditional Questionnaires, and Interviews , 1999 .

[14]  W. Aquilino,et al.  A Comparison of Computer-Assisted and Paper-and-Pencil Self-Administered Questionnaires in a Survey on Smoking, Alcohol, and Drug Use , 1998 .

[15]  Richard F. Catalano,et al.  Measuring risk and protective factors for substance use, delinquency, and other adolescent problem behaviors. The Communities That Care Youth Survey. , 2002 .

[16]  Patrick M. O'Malley,et al.  Monitoring the Future National Results on Adolescent Drug Use: Overview of Key Findings, 2004. , 2003 .

[17]  Lea Maes,et al.  Comparison of a computer-administered and paper-and-pencil-administered questionnaire on health and lifestyle behaviors. , 2006, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[18]  Evangeline R. Danseco,et al.  Perceived Risk of Harm from Marijuana Use among Youth in the USA , 1999 .

[19]  Graham R. Walden.  Survey Research Methodology, 1990-1999: An Annotated Bibliography , 2002 .