Strategies to address participant misrepresentation for eligibility in Web‐based research

Emerging methodological research suggests that the World Wide Web (“Web”) is an appropriate venue for survey data collection, and a promising area for delivering behavioral intervention. However, the use of the Web for research raises concerns regarding sample validity, particularly when the Web is used for recruitment and enrollment. The purpose of this paper is to describe the challenges experienced in two different Web‐based studies in which participant misrepresentation threatened sample validity: a survey study and an online intervention study. The lessons learned from these experiences generated three types of strategies researchers can use to reduce the likelihood of participant misrepresentation for eligibility in Web‐based research. Examples of procedural/design strategies, technical/software strategies and data analytic strategies are provided along with the methodological strengths and limitations of specific strategies. The discussion includes a series of considerations to guide researchers in the selection of strategies that may be most appropriate given the aims, resources and target population of their studies. Copyright © 2014 John Wiley & Sons, Ltd.

[1]  F. Rotgers.  Motivational Interviewing: Preparing People to Change Addictive Behavior , 1993 .

[2]  Heleen Riper,et al.  Effectiveness of E-Self-help Interventions for Curbing Adult Problem Drinking: A Meta-analysis , 2011, Journal of medical Internet research.

[3]  E. Chiauzzi,et al.  A Randomized Trial of a Web‐Based Intervention to Improve Migraine Self‐Management and Coping , 2012, Headache.

[4]  Candice M. Daniel,et al.  Identifying Multiple Submissions in Internet Research: Preserving Data Integrity , 2008, AIDS and Behavior.

[5]  Daniel Z. Lieberman.  Evaluation of the Stability and Validity of Participant Samples Recruited over the Internet , 2008, Cyberpsychology Behav. Soc. Netw..

[6]  Joseph A. Konstan,et al.  The Story of Subject Naught: A Cautionary but Optimistic Tale of Internet Survey Research , 2006, J. Comput. Mediat. Commun..

[7]  Barry Mazur,et al.  This is the Story. , 1952, Canadian Medical Association journal.

[8]  D. Lansky,et al.  Online Consumer Surveys as a Methodology for Assessing the Quality of the United States Health Care System , 2004, Journal of medical Internet research.

[9]  W. Coster,et al.  A New Approach to the Measurement of Adaptive Behavior: Development of the PEDI-CAT for Children and Youth with Autism Spectrum Disorders , 2012, Physical & occupational therapy in pediatrics.

[10]  J. Wyatt,et al.  Using the Internet for Surveys and Health Research , 2002, Journal of medical Internet research.

[11]  Jacqueline Mogle.  Internet-Based Assessment , 2015 .

[12]  Kevin B. Wright,et al.  Researching Internet-Based Populations: Advantages and Disadvantages of Online Survey Research, Online Questionnaire Authoring Software Packages, and Web Survey Services , 2006, J. Comput. Mediat. Commun..

[13]  Jolene Galegher,et al.  The Health Insurance Portability and Accountability Act Privacy Rule: A Practical Guide for Researchers , 2004, Medical care.

[14]  C. Hoge,et al.  Combat duty in Iraq and Afghanistan, mental health problems and barriers to care. , 2004, U.S. Army Medical Department journal.

[15]  T. Wells,et al.  Alcohol use and alcohol-related problems before and after military combat deployment. , 2008, JAMA.

[16]  S. Haley,et al.  Accuracy and precision of the Pediatric Evaluation of Disability Inventory computer‐adaptive tests (PEDI‐CAT) , 2011, Developmental medicine and child neurology.

[17]  I. White,et al.  Methodological Challenges in Online Trials , 2009, Journal of medical Internet research.

[18]  Williams,et al.  Effectiveness of e-self-help interventions for curbing adult problem drinking : a meta-analysis , 2009 .

[19]  A. H. Berman,et al.  Internet-based assessment and self-monitoring of problematic alcohol and drug use. , 2010, Addictive behaviors.

[20]  Ifan D. H. Shepherd,et al.  Using the internet , 1997 .

[21]  Shuo Wang,et al.  Challenges of Internet Recruitment: A Case Study with Disappointing Results , 2005, Journal of medical Internet research.

[22]  Mark Petticrew,et al.  Effects of a Financial Incentive on Health Researchers’ Response to an Online Survey: a Randomized Controlled Trial , 2010, Journal of medical Internet research.

[23]  E. Robb,et al.  Not paying attention? , 2004, British Dental Journal.