Cash Lotteries as Incentives in Online Panels

Six incentive experiments were conducted in a nonprofit online panel. In each experiment, the incentive offered for participation was a cash lottery. The control group was not offered any incentive. The cash lottery was offered in two versions: Either the total payout of the lottery was mentioned, or the lottery was split into multiple prizes. Dependent measures included response and retention rates. The results of the six individual experiments were meta-analytically summarized. Cash lotteries relative to no incentives did not reliably increase response or retention; neither did it make a significant difference if one large prize or multiple smaller prizes were raffled.

[1]  Ulf-Dietrich Reips,et al.  Financial Incentives, Personal Information and Drop Out in Online Studies , 2001 .

[2]  William R. Shadish,et al.  Using odds ratios as effect sizes for meta-analysis of dichotomous data: A primer on methods and issues. , 1998 .

[3]  Steven D. Penrod,et al.  Methodological variables in Web-based research that may affect results: Sample type, monetary incentives, and personal information , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[4]  Brian H. Bornstein,et al.  Web-based research: Methodological variables’ effects on dropout and sample characteristics , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[5]  Katelyn Y. A. McKenna,et al.  Oxford Handbook of Internet Psychology , 2007 .

[6]  Julian P T Higgins,et al.  Controlling the risk of spurious findings from meta‐regression , 2004, Statistics in medicine.

[7]  A. Göritz.  Recruitment for online access panels , 2004 .

[8]  M. Couper.  A REVIEW OF ISSUES AND APPROACHES , 2000 .

[9]  Anja S. Göritz,et al.  The impact of material incentives on response quantity, response quality, sample composition, survey outcome, and cost in online access panels , 2004 .

[10]  Tracy L. Tuten,et al.  Effects of Immediate Versus Delayed Notification of Prize Draw Results on Response Behavior in Web Surveys , 2004 .

[11]  Joseph L. Fleiss,et al.  Measures of effect size for categorical data. , 1994 .

[12]  M. Birnbaum,et al.  Organizational Behavior and Human Decision Processes Tests of Theories of Decision Making: Violations of Branch Independence and Distribution Independence Generic Rank-dependent Utility Generic Analysis of Violations of Branch Independence and Distribution Independence Birnbaum and Mcintosh Model: N , 2022 .

[13]  S. Thompson,et al.  Detecting and describing heterogeneity in meta-analysis. , 1998, Statistics in medicine.

[14]  Michael H. Birnbaum,et al.  How to show that 9 > 221 : Collect judgments in a between-subjects design , 1999 .

[15]  Bernad Batinic,et al.  Determinanten der Rücklaufquote in Online-Panels , 2005, Z. für Medienpsychologie.

[16]  A. H. Church.  ESTIMATING THE EFFECT OF INCENTIVES ON MAIL SURVEY RESPONSE RATES: A META-ANALYSIS , 1993 .

[17]  A. Tversky,et al.  Risk Attitudes and Decision Weights , 1995 .

[18]  S. Thompson,et al.  How should meta‐regression analyses be undertaken and interpreted? , 2002, Statistics in medicine.

[19]  Tracy L. Tuten,et al.  Prepaid and Promised Incentives in Web Surveys , 2003 .

[20]  E. Singer,et al.  Leverage-saliency theory of survey participation: description and an illustration. , 2000, Public opinion quarterly.