Comparison of paper-and-pencil versus Web administration of the Youth Risk Behavior Survey (YRBS): Participation, data quality, and perceived privacy and anonymity

The Youth Risk Behavior Surveillance System (YRBSS) monitors priority health-risk behaviors among US high school students. To better understand the ramifications of changing the YRBSS from paper-and-pencil to Web administration, in 2008 the Centers for Disease Control and Prevention conducted a study comparing these two modes of administration. Eighty-five schools in 15 states agreed to participate in the study. Within each participating school, four classrooms of students in grades 9 or 10 were randomly assigned to complete the Youth Risk Behavior Survey questionnaire in one of four conditions (in-class paper-and-pencil, in-class Web without programmed skip patterns, in-class Web with programmed skip patterns, and ''on your own'' Web without programmed skip patterns). Findings included less missing data for the paper-and-pencil condition (1.5% vs. 5.3%, 4.4%, 6.4%; p<.001), less perceived privacy and anonymity among respondents for the in-class Web conditions, and a lower response rate for the ''on your own'' Web condition than for in-class administration by either mode (28.0% vs. 91.2%, 90.1%, 91.4%; p<.001). Although Web administration might be useful for some surveys, these findings do not favor the use of a Web survey for the YRBSS.

[1]  J. Billy,et al.  Assessment of factors affecting the validity of self-reported health-risk behavior among adolescents: evidence from the scientific literature. , 2003, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[2]  James A. McRae,et al.  An Evaluation of Computer-Assisted Self-Interviews in a School Setting , 1998 .

[3]  P. Looij-Jansen,et al.  Comparison of web-based versus paper-and-pencil self-administered questionnaire: effects on health indicators in Dutch adolescents. , 2008 .

[4]  Ying Wu,et al.  Comparing data collected by computerized and written surveys for adolescence health research. , 2007, The Journal of school health.

[5]  Leslie Herrmann,et al.  How important are interview methods and questionnaire designs in research on self-reported juvenile delinquency? An experimental comparison of Internet vs paper-and-pencil questionnaires and different definitions of the reference period , 2007 .

[6]  Laura Kann,et al.  Methodology of the youth risk behavior surveillance system. , 2004, MMWR. Recommendations and reports : Morbidity and mortality weekly report. Recommendations and reports.

[7]  Laura Kann,et al.  Comparison of Paper-and-Pencil Versus Web Administration of the Youth Risk Behavior Survey (YRBS): Risk Behavior Prevalence Estimates , 2010, Evaluation review.

[8]  Nancy D. Brener,et al.  The Association of Survey Setting and Mode with Self-Reported Health Risk Behaviors among High School Students , 2006 .

[9]  Scott C. Bates,et al.  The impact of computer versus paper-pencil survey, and individual versus group administration, on self-reports of sensitive behaviors , 2008, Comput. Hum. Behav..

[10]  D. Dillman Mail and internet surveys: The tailored design method, 2nd ed. , 2007 .

[11]  Jeanne M. Landgraf,et al.  Feasibility, reliability, and validity of adolescent health status measurement by the Child Health Questionnaire Child Form (CHQ-CF): internet administration compared with the standard paper version , 2007, Quality of Life Research.

[12]  Martyn Denscombe,et al.  Web-Based Questionnaires and the Mode Effect , 2006 .