Exploring micro-incentive strategies for participant compensation in high-burden studies

Micro-incentives represent a new but little-studied trend in participant compensation for user studies. In this paper, we use a combination of statistical analysis and models from labor economics to evaluate three canonical micro-payment schemes in the context of high-burden user studies, where participants wear sensors for extended durations. We look at how these strategies affect compliance, data quality, and retention, and show that when used carefully, micro-payments can be highly beneficial. We find that data quality is different across the micro-incentive schemes we experimented with, and therefore the incentive strategy should be chosen with care. We think that adaptive micro-payment based incentives can be used to successfully incentivize future studies at much lower cost to the study designer, while ensuring high compliance, good data quality, and lower retention issues.

[1]  D. W. Leonard,et al.  The effects of varying schedules of reinforcement on human task performance , 1976 .

[2]  Kent Larson,et al.  Tools for Studying Behavior and Technology in Natural Settings , 2003, UbiComp.

[3]  Hector Garcia-Molina,et al.  PPay: micropayments for peer-to-peer systems , 2003, CCS '03.

[4]  T. Kamarck,et al.  Experiences of demand and control in daily life as correlates of subclinical carotid atherosclerosis in a healthy older sample. , 2004, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[5]  R. L. Reid The psychology of the near miss , 1986, Journal of gambling behavior.

[6]  Scott E. Hudson,et al.  Using visualizations to increase compliance in experience sampling , 2008, UbiComp.

[7]  Emre Ertin,et al.  Continuous inference of psychological stress from sensory measurements collected in the natural environment , 2011, Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks.

[8]  Hiroaki Kimura,et al.  Applying pervasive technologies to create economic incentives that alter consumer behavior , 2009, UbiComp.

[9]  L. F. Barrett,et al.  A Practical Guide to Experience-Sampling Procedures , 2003 .

[10]  C. Grady,et al.  An analysis of U.S. practices of paying research participants. , 2005, Contemporary clinical trials.

[11]  Sunny Consolvo,et al.  Using the Experience Sampling Method to Evaluate Ubicomp Applications , 2003, IEEE Pervasive Comput..

[12]  James A. Landay,et al.  The Mobile Sensing Platform: An Embedded Activity Recognition System , 2008, IEEE Pervasive Computing.

[13]  Thomas J. Smith,et al.  The Association Between Personal Measurements of Environmental Exposure to Particulates and Heart Rate Variability , 2002, Epidemiology.

[14]  T. Kamarck,et al.  Hostility explains some of the discrepancy between daytime ambulatory and clinic blood pressures. , 2002, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[15]  C. B. Ferster,et al.  Schedules of reinforcement , 1957 .

[16]  Deborah Estrin,et al.  Examining micro-payments for participatory sensing data collections , 2010, UbiComp.

[17]  Duncan J. Watts,et al.  Financial incentives and the "performance of crowds" , 2009, HCOMP '09.

[18]  Adi Shamir,et al.  PayWord and MicroMint: Two Simple Micropayment Schemes , 1996, Security Protocols Workshop.

[19]  Jeffrey Heer,et al.  Crowdsourcing graphical perception: using mechanical turk to assess visualization design , 2010, CHI.

[20]  R. Cialdini Influence: Science and Practice , 1984 .

[21]  J. McGonigal Reality Is Broken: Why Games Make Us Better and How They Can Change the World , 2011 .

[22]  A. H. Church ESTIMATING THE EFFECT OF INCENTIVES ON MAIL SURVEY RESPONSE RATES: A META-ANALYSIS , 1993 .

[23]  Emre Ertin,et al.  mConverse: inferring conversation episodes from respiratory measurements collected in the field , 2011, Wireless Health.

[24]  Robert M. Nelson,et al.  Voluntariness of Consent for Research: An Empirical and Conceptual Review , 2002, Medical care.