Incentive Mechanism Design to Meet Task Criteria in Crowdsourcing: How to Determine Your Budget

In crowdsourcing markets, a requester announces a task and calls for contribution from potential participants. With strategic participants, the requester needs to reward the participants to introduce the incentives of participation. However, it is natural to ask whether it is worth introducing incentives if the total payment for eliciting incentives is too high. This paper addresses such a fundamental concern by designing a frugal mechanism with minimum payment used to procure the total amount of service contributions demanded. We design two mechanisms to provide the incentives of participation while minimizing the payment used by the requester. We first propose a frugal auction-based mechanism, which stimulates participants to truthfully report their information. We theoretically prove that the payment used is not more than the optimal cost (with no incentive considered) plus a bounded additive. We then design a Stackelberg-game-based mechanism, in which the requester fixes a certain total payment at the very beginning so as to encourage the participants to compete for it and participate in the task. We verify the existence of a unique Nash equilibrium (NE) and develop a novel algorithm to find the NE, as well as the optimal payment to extract the NE. Our simulation results show that the payment used in these mechanisms is close to the optimal solution with no incentive considered, while the extra payment caused by introducing truthfulness in auction-based mechanism is about twice that of the NE in Stakelberg-game-based mechanism.

[1]  Amos Azaria,et al.  Automated agents for reward determination for human work in crowdsourcing applications , 2014, Autonomous Agents and Multi-Agent Systems.

[2]  Nenghai Yu,et al.  Incentivizing High-Quality Content from Heterogeneous Users: On the Existence of Nash Equilibrium , 2014, AAAI.

[3]  Gagan Goel,et al.  Mechanism Design for Crowdsourcing: An Optimal 1-1/e Competitive Budget-Feasible Mechanism for Large Markets , 2014, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[4]  Éva Tardos,et al.  Truthful mechanisms for one-parameter agents , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[5]  Thomas Sandholm,et al.  Dynamic Proportional Share Scheduling in Hadoop , 2010, JSSPP.

[6]  Kenneth Steiglitz,et al.  Frugality in path auctions , 2004, SODA '04.

[7]  Sarit Kraus,et al.  Forming efficient agent groups for completing complex tasks , 2006, AAMAS '06.

[8]  Kunal Talwar,et al.  The Price of Truth: Frugality in Truthful Mechanisms , 2003, STACS.

[9]  Chunyan Miao,et al.  Market Based Resource Allocation with Incomplete Information , 2007, IJCAI.

[10]  Athanasios V. Vasilakos,et al.  TRAC: Truthful auction for location-aware collaborative sensing in mobile crowdsourcing , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[11]  Paul W. Goldberg,et al.  Commodity Auctions and Frugality Ratios , 2012, SAGT.

[12]  Iordanis Koutsopoulos,et al.  Optimal incentive-driven design of participatory sensing systems , 2013, 2013 Proceedings IEEE INFOCOM.

[13]  Chien-Ju Ho,et al.  Adaptive Task Assignment for Crowdsourced Classification , 2013, ICML.

[14]  Ning Chen,et al.  On the approximability of budget feasible mechanisms , 2010, SODA '11.

[15]  Hwee Pink Tan,et al.  Profit-maximizing incentive for participatory sensing , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[16]  Gruia Calinescu Bounding the payment of approximate truthful mechanisms , 2015, Theor. Comput. Sci..

[17]  Gagan Goel,et al.  Mechanism Design for Crowdsourcing Markets with Heterogeneous Tasks , 2014, HCOMP.

[18]  Noam Nisan,et al.  Algorithmic Mechanism Design , 2001, Games Econ. Behav..

[19]  Mingyan Liu,et al.  An Online Learning Approach to Improving the Quality of Crowd-Sourcing , 2015, SIGMETRICS.

[20]  Lei Chen,et al.  Free Market of Crowdsourcing: Incentive Mechanism Design for Mobile Sensing , 2014, IEEE Transactions on Parallel and Distributed Systems.

[21]  Frank Kelly,et al.  Rate control for communication networks: shadow prices, proportional fairness and stability , 1998, J. Oper. Res. Soc..

[22]  Chien-Ju Ho,et al.  Online Task Assignment in Crowdsourcing Markets , 2012, AAAI.

[23]  Michal Feldman,et al.  The Proportional-Share Allocation Market for Computational Resources , 2009, IEEE Transactions on Parallel and Distributed Systems.

[24]  Arpita Ghosh,et al.  Incentives, gamification, and game theory: an economic approach to badge design , 2013, EC '13.

[25]  Liang Liu,et al.  Frugal Online Incentive Mechanisms for Mobile Crowd Sensing , 2017, IEEE Transactions on Vehicular Technology.

[26]  Nicholas R. Jennings,et al.  Efficient crowdsourcing of unknown experts using bounded multi-armed bandits , 2014, Artif. Intell..

[27]  Sajal K. Das,et al.  Incentive Mechanisms for Participatory Sensing , 2015, ACM Trans. Sens. Networks.

[28]  Xiaoying Gan,et al.  Incentivize crowd labeling under budget constraint , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[29]  Mihaela van der Schaar,et al.  Reputation-based incentive protocols in crowdsourcing applications , 2011, 2012 Proceedings IEEE INFOCOM.

[30]  Adam Wierman,et al.  Energy procurement strategies in the presence of intermittent sources , 2014, SIGMETRICS '14.

[31]  Anna R. Karlin,et al.  Beyond VCG: frugality of truthful mechanisms , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[32]  Cong Wang,et al.  Secure and practical outsourcing of linear programming in cloud computing , 2011, 2011 Proceedings IEEE INFOCOM.

[33]  Liang Liu,et al.  Frugal Online Incentive Mechanisms for Crowdsourcing Tasks Truthfully , 2014, ArXiv.

[34]  George Q. Huang,et al.  Truthful multi-unit transportation procurement auctions for logistics e-marketplaces , 2013 .

[35]  Chen-Khong Tham,et al.  Quality of Contributed Service and Market Equilibrium for Participatory Sensing , 2013, IEEE Transactions on Mobile Computing.

[36]  R. Preston McAfee,et al.  Incentivizing high-quality user-generated content , 2011, WWW.

[37]  Matti Siekkinen,et al.  Using crowd-sourced viewing statistics to save energy in wireless video streaming , 2013, MobiCom.

[38]  Yaron Singer,et al.  Budget Feasible Mechanisms , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[39]  Cristopher Moore,et al.  Frugal and Truthful Auctions for Vertex Covers, Flows and Cuts , 2009, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[40]  Nicholas R. Jennings,et al.  Flexible Procurement of Services with Uncertain Durations using Redundancy , 2009, IJCAI.

[41]  Xi Fang,et al.  Crowdsourcing to smartphones: incentive mechanism design for mobile phone sensing , 2012, Mobicom '12.

[42]  Alon Y. Halevy,et al.  Crowdsourcing systems on the World-Wide Web , 2011, Commun. ACM.

[43]  Jean C. Walrand,et al.  Motivating Smartphone Collaboration in Data Acquisition and Distributed Computing , 2014, IEEE Transactions on Mobile Computing.