Participant Dropout as a Function of Survey Length in Internet-Mediated University Studies: Implications for Study Design and Voluntary Participation in Psychological Research

Internet-mediated research has offered substantial advantages over traditional laboratory-based research in terms of efficiently and affordably allowing for the recruitment of large samples of participants for psychology studies. Core technical, ethical, and methodological issues have been addressed in recent years, but the important issue of participant dropout has received surprisingly little attention. Specifically, web-based psychology studies often involve undergraduates completing lengthy and time-consuming batteries of online personality questionnaires, but no known published studies to date have closely examined the natural course of participant dropout during attempted completion of these studies. The present investigation examined participant dropout among 1,963 undergraduates completing one of six web-based survey studies relatively representative of those conducted in university settings. Results indicated that 10% of participants could be expected to drop out of these studies nearly instantaneously, with an additional 2% dropping out per 100 survey items included in the study. For individual project investigators, these findings hold ramifications for study design considerations, such as conducting a priori power analyses. The present results also have broader ethical implications for understanding and improving voluntary participation in research involving human subjects. Nonetheless, the generalizability of these conclusions may be limited to studies involving similar design or survey content.

[1]  Richard E. Lucas,et al.  Immune neglect in affective forecasting. , 2009 .

[2]  Amit Jain,et al.  Predictors of Drop-Out in an Internet Study of Men Who Have Sex with Men , 2008, Cyberpsychology Behav. Soc. Netw..

[3]  Christian Montag,et al.  Does Speed in Completing an Online Questionnaire Have an Influence on Its Reliability? , 2008, Cyberpsychology Behav. Soc. Netw..

[4]  Michael Hoerger,et al.  Effects of situational demand upon social enjoyment and preference in schizotypy. , 2007, Journal of abnormal psychology.

[5]  N. Shafiq,et al.  Evaluation of the ability of clinical research participants to comprehend informed consent form. , 2009, Contemporary clinical trials.

[6]  Filip Lievens,et al.  Measurement Equivalence of Paper‐and‐Pencil and Internet Organisational Surveys: A Large Scale Examination in 16 Countries , 2009 .

[7]  Michael Hoerger,et al.  When does haste make waste? Speed-accuracy tradeoff, skill level, and the tools of the trade. , 2008, Journal of experimental psychology. Applied.

[8]  Michael Hoerger,et al.  Affective forecasting and the Big Five. , 2010, Personality and individual differences.

[9]  S. Gosling,et al.  Development of personality in early and middle adulthood: set like plaster or persistent change? , 2003, Journal of personality and social psychology.

[10]  Janine E. Janosky,et al.  Application of the Single Subject Design in Biomedicine , 2009 .

[11]  Stuart Myerburg,et al.  Measurement Issues Related to Data Collection on the World Wide Web , 2003, ANS. Advances in nursing science.

[12]  Janine E. Janosky,et al.  Methodological Framework for Single Subject Designs , 2009 .

[13]  Edward G. Sargis,et al.  The internet as psychological laboratory. , 2006, Annual review of psychology.

[14]  Peter Hoonakker,et al.  Questionnaire Survey Nonresponse: A Comparison of Postal Mail and Internet Surveys , 2009, Int. J. Hum. Comput. Interact..

[15]  Martin Grunwald,et al.  A Comparison of Different Survey Periods in Online Surveys of Persons with Eating Disorders and Their Relatives , 2009, Annual Review of Cybertherapy and Telemedicine.

[16]  Michael Hoerger,et al.  Racial bias in personality assessment: using the MMPI-2 to predict psychiatric diagnoses of African American and Caucasian chemical dependency inpatients. , 2009, Psychological assessment.

[17]  Morton A. Lieberman,et al.  Psychological Characteristics of People with Parkinson's Disease Who Prematurely Drop Out of Professionally Led Internet Chat Support Groups , 2007, Cyberpsychology Behav. Soc. Netw..

[18]  Yves Hänggi Stress and Emotion Recognition: An Internet Experiment Using Stress Induction , 2004 .

[19]  Anthony G. Greenwald,et al.  E‐Research: Ethics, Security, Design, and Control in Psychological Research on the Internet , 2002 .

[20]  Monica Martinussen,et al.  Survey Response Rates and Survey Administration in Counseling and Clinical Psychology , 2009 .

[21]  M. Banaji,et al.  Psychological. , 2015, The journals of gerontology. Series B, Psychological sciences and social sciences.

[22]  Michael H. Birnbaum,et al.  Introduction to Behavioral Research on the Internet , 2000 .

[23]  Traci L Mann,et al.  Informed Consent for Psychological Research: Do Subjects Comprehend Consent Forms and Understand Their Legal Rights? , 1994 .

[24]  S. Gosling,et al.  Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires. , 2004, The American psychologist.

[25]  Daniel Z. Lieberman Evaluation of the Stability and Validity of Participant Samples Recruited over the Internet , 2008, Cyberpsychology Behav. Soc. Netw..

[26]  R. Chris Fraley How to conduct behavioral research over the Internet , 1992 .

[27]  Richard E. Lucas,et al.  Cognitive determinants of affective forecasting errors. , 2010, Judgment and decision making.

[28]  Brian A. Nosek,et al.  Harvesting implicit group attitudes and beliefs from a demonstration web site , 2002 .

[29]  G. S. Bowen,et al.  The Internet as recruitment tool for HIV studies: viable strategy for reaching at-risk Hispanic MSM in Miami? , 2004, AIDS care.

[30]  Michael Hoerger,et al.  Ethical issues in Internet research. , 2012 .

[31]  Jeffrey D. Fisher,et al.  The Internet: A Virtually Untapped Tool for Research , 2002 .

[32]  Janine E. Janosky,et al.  Ethics and Single Subject Research , 2009 .