The open incentive kit (OINK): standardizing the generation, comparison, and deployment of incentive systems

Incentives are a key facet of human studies research, yet the state-of-the-art often designs and implements incentive systems in an ad-hoc, on-demand manner. We introduce the first vocabulary for formally describing incentive systems and develop a software infrastructure that enables UI-based graphical generation of complex, auditable, reliable, and reproducible incentive systems. We call this infrastructure the Open INcentive Kit (OINK). A review of recent literature from several communities finds that of the one hundred and twenty-one publications that incorporate incentives, only thirty-one describe their incentive system in detail, and all of these could be implemented using OINK. We evaluate OINK in practice by using it for an active energy monitoring deployment in Ghana and find that OINK successfully facilitates thousands of individual incentive payments. Finally, we describe our efforts to generalize OINK for different research communities, specifically focusing on architectural decisions around extensibility to support unanticipated use cases. OINK is free and open-source software.

[1]  Peter D. Schellie Electronic Fund Transfer Act , 2016 .

[2]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[3]  Daeyeol Lee,et al.  Symbol addition by monkeys provides evidence for normalized quantity coding , 2014, Proceedings of the National Academy of Sciences.

[4]  Gaetano Borriello,et al.  Open data kit sensors: mobile data collection with wired and wireless sensors , 2012, ACM DEV '12.

[5]  Robin P. Cubitt,et al.  On the Validity of the Random Lottery Incentive System , 1998 .

[6]  Irene M. Pepperberg,et al.  Robust representation of shape in a Grey parrot (Psittacus erithacus) , 2016, Cognition.

[7]  Dale Whittington,et al.  Estimating the Willingness to Pay for Water Services in Developing Countries: A Case Study of the Use of Contingent Valuation Surveys in Southern Haiti , 1990, Economic Development and Cultural Change.

[8]  Maria Elena Miletto Petrazzini,et al.  Trained Quantity Abilities in Horses (Equus caballus): A Preliminary Investigation , 2014, Behavioral sciences.

[9]  Laurence Moroney Firebase Cloud Messaging , 2017 .

[10]  Iordanis Koutsopoulos,et al.  Optimal incentive-driven design of participatory sensing systems , 2013, 2013 Proceedings IEEE INFOCOM.

[11]  Steven Ovadia Automate the Internet With “If This Then That” (IFTTT) , 2014 .

[12]  Lin Gao,et al.  Providing long-term participation incentive in participatory sensing , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[13]  Milena Radenkovic,et al.  A Feasibility Study of an In-the-Wild Experimental Public Access WiFi Network , 2014, ACM DEV-5 '14.

[14]  U. Gneezy,et al.  Journal of Economic Perspectives—Volume 25, Number 4—Fall 2011—Pages 191–210 When and Why Incentives (Don’t) Work to Modify Behavior , 2022 .

[15]  C. Grady,et al.  Payment of clinical research subjects. , 2005, The Journal of clinical investigation.

[16]  Grant Potter Grafana: open platform for analytics and monitoring , 2018 .

[17]  Lorrie Faith Cranor,et al.  Institutional Review Boards and Your Research: A Proposal for Improving the Review Procedures for Research Projects that Involve Human Subjects and Their Associated Identifiable Private Information , 2010 .

[18]  Matthew Podolsky,et al.  Grid watch: mapping blackouts with smart phones , 2014, HotMobile.

[19]  Zhu Wang,et al.  Mobile Crowd Sensing and Computing , 2015, ACM Comput. Surv..

[20]  Matthew C. Jadud IRB reviews required , 2016, SGCS.

[21]  Lei Chen,et al.  Free Market of Crowdsourcing: Incentive Mechanism Design for Mobile Sensing , 2014, IEEE Transactions on Parallel and Distributed Systems.

[22]  Lilly Irani,et al.  Amazon Mechanical Turk , 2018, Advances in Intelligent Systems and Computing.

[23]  R. Cavalcanti,et al.  Incentives for recruiting trainee participants in medical education research , 2017, Medical teacher.

[24]  Stanley Lippert,et al.  A Comprehensive Approach to Human Factors in Developing Countries , 1968 .

[25]  Yunhao Liu,et al.  Incentives for Mobile Crowd Sensing: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[26]  E. A. Locke Toward a theory of task motivation and incentives , 1968 .

[27]  Eleanor Singer,et al.  The Use and Effects of Incentives in Surveys , 2013 .

[28]  Gaetano Borriello,et al.  Open data kit: tools to build information services for developing regions , 2010, ICTD.

[29]  Colin Camerer,et al.  The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework , 1999 .