Assessing response bias in a web survey at a university faculty

Abstract Online surveys are increasingly common due to the myriad of benefits they offer over traditional survey methods. However, research has shown that response rates to web-based surveys are typically lower than to traditional surveys and can possibly yield biased results. University-based faculty members are a unique cohort that may be ideally suited as subjects for web-based surveys. This paper presents the results of a formal assessment of response bias from a large scale anonymous national survey of faculty members in the discipline of health administration. Results suggested that response bias was at levels undetectable using standard methodological approaches. This paper provides the reader with an overview of steps that can assist evaluators in assessing response bias from data collected with surveys. Thus, it will be of interest to researchers utilising electronic survey methods, especially those interested in surveying university-based faculty members.

[1]  R. Knibbe,et al.  The utility of online panel surveys versus computer-assisted interviews in obtaining substance-use prevalence estimates in the Netherlands. , 2009, Addiction.

[2]  Martin P Eccles,et al.  Response rates in postal surveys of healthcare professionals between 1996 and 2005: An observational study , 2009, BMC health services research.

[3]  J. Cawley.  The Earnings of University Faculty in Health Administration: What Characteristics Influence Pay? , 2009 .

[4]  M. Vrijheid,et al.  Quantifying the impact of selection bias caused by nonparticipation in a case-control study of mobile phone use. , 2009, Annals of epidemiology.

[5]  Jeffry S. Gordon,et al.  Developing the online survey. , 2008, The Nursing clinics of North America.

[6]  Margo C. Orchard,et al.  Response Audit of an Internet Survey of Health Care Providers and Administrators: Implications for Determination of Response Rates , 2008, Journal of medical Internet research.

[7]  C. Gaither,et al.  A national survey of U.S. pharmacists in 2000: Assessing nonresponse bias of a survey methodology , 2008, AAPS PharmSci.

[8]  R. Zambrana,et al.  Surveying free and low-cost survey software. , 2006, Journal of the National Medical Association.

[9]  Neset Hikmet,et al.  Investigating Response Bias in an Information Technology Survey of Physicians , 2006, Journal of Medical Systems.

[10]  G. Guyatt,et al.  Procedures that assess inconsistency in meta-analyses can assess the likelihood of response bias in multiwave surveys. , 2005, Journal of clinical epidemiology.

[11]  Elie A Akl,et al.  Electronic mail was not better than postal mail for surveying residents and faculty. , 2005, Journal of clinical epidemiology.

[12]  Emil H Schemitsch,et al.  Internet Versus Mailed Questionnaires: A Controlled Comparison (2) , 2004, Journal of medical Internet research.

[13]  M. Godwin,et al.  E-mail or snail mail? Randomized controlled trial on which works better for surveys. , 2004, Canadian family physician Medecin de famille canadien.

[14]  D. Lansky,et al.  Online Consumer Surveys as a Methodology for Assessing the Quality of the United States Health Care System , 2004, Journal of medical Internet research.

[15]  Shaw K. Chen,et al.  An investigation into low mail survey response rates of information technology users in health care organizations , 2003, Int. J. Medical Informatics.

[16]  Stephen Sutton,et al.  Using the Internet to conduct surveys of health professionals: a valid alternative? , 2003, Family practice.

[17]  Mehran S Massoudi,et al.  Comparison of e-mail, fax, and postal surveys of pediatricians. , 2003, Pediatrics.

[18]  J. Wyatt,et al.  Using the Internet for Surveys and Health Research , 2002, Journal of medical Internet research.

[19]  C. Koopman,et al.  An Example of Maximizing Survey Return Rates , 2002, Evaluation & the health professions.

[20]  M. Weiner,et al.  E-mail versus conventional postal mail survey of geriatric chiefs. , 2001, The Gerontologist.

[21]  Titus Schleyer,et al.  Research Paper: Methods for the Design and Administration of Web-based Surveys , 2000, J. Am. Medical Informatics Assoc..

[22]  R. Jones,et al.  Health surveys in the workplace: comparison of postal, email and World Wide Web methods. , 1999, Occupational medicine.

[23]  B. Mavis,et al.  Postal Surveys versus Electronic Mail Surveys , 1998, Evaluation & the health professions.

[24]  T V Perneger,et al.  Analysis of non-response bias in a mailed health survey. , 1997, Journal of clinical epidemiology.

[25]  D A Asch,et al.  Response rates to mail surveys published in medical journals. , 1997, Journal of clinical epidemiology.

[26]  N. C. Schaeffer,et al.  Institute for Research on Poverty Discussion Paper no. 1024-93 Using Survey Participants to Estimate the Impact of Nonparticipation , 1993 .

[27]  P. Leatt,et al.  Future directions for AUPHA (Association of University Programs in Health Administration)? Results of a survey of faculty members. , 1988, The Journal of health administration education.

[28]  J. Polich,et al.  Response Bias and Reliability in Sensitive Topic Surveys , 1986 .

[29]  Terry S. Overton,et al.  Estimating Nonresponse Bias in Mail Surveys , 1977 .