Data Quality Guided Incentive Mechanism Design for Crowdsensing

In crowdsensing, appropriate rewards are always expected to compensate the participants for their consumptions of physical resources and involvements of manual efforts. While continuous low quality sensing data could do harm to the availability and preciseness of crowdsensing based services, few existing incentive mechanisms have ever addressed the issue of data quality. The design of quality based incentive mechanism is motivated by its potential to avoid inefficient sensing and unnecessary rewards. In this paper, we incorporate the consideration of data quality into the design of incentive mechanism for crowdsensing, and propose to pay the participants as how well they do, to motivate the rational participants to efficiently perform crowdsensing tasks. This mechanism estimates the quality of sensing data, and offers each participant a reward based on her effective contribution. We also implement the mechanism and evaluate its improvement in terms of quality of service and profit of service provider. The evaluation results show that our mechanism achieves superior performance when compared to general data collection model and uniform pricing scheme.

[1]  Athanasios V. Vasilakos,et al.  TRAC: Truthful auction for location-aware collaborative sensing in mobile crowdsourcing , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[2]  Guan Wang,et al.  Crowdsourcing from Scratch: A Pragmatic Experiment in Data Collection by Novice Requesters , 2015, HCOMP.

[3]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[4]  Maria E. Niessen,et al.  NoiseTube: Measuring and mapping noise pollution with mobile phones , 2009, ITEE.

[5]  Ioannis Krontiris,et al.  Monetary incentives in participatory sensing using multi-attributive auctions , 2012, Int. J. Parallel Emergent Distributed Syst..

[6]  Ye Tian,et al.  Revealing, characterizing, and detecting crowdsourcing spammers: A case study in community Q&A , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[7]  Xiaoying Gan,et al.  Incentivize crowd labeling under budget constraint , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[8]  Yin Wang,et al.  CrowdAtlas: self-updating maps for cloud and personal use , 2013, MobiSys '13.

[9]  Mihaela van der Schaar,et al.  Reputation-based incentive protocols in crowdsourcing applications , 2011, 2012 Proceedings IEEE INFOCOM.

[10]  Fan Ye,et al.  Mobile crowdsensing: current state and future challenges , 2011, IEEE Communications Magazine.

[11]  Xi Fang,et al.  Crowdsourcing to smartphones: incentive mechanism design for mobile phone sensing , 2012, Mobicom '12.

[12]  Panagiotis G. Ipeirotis,et al.  Quality-Based Pricing for Crowdsourced Workers , 2013 .

[13]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[14]  Mausam,et al.  Optimal Testing for Crowd Workers , 2016, AAMAS.

[15]  Mo Li,et al.  How Long to Wait? Predicting Bus Arrival Time With Mobile Phone Based Participatory Sensing , 2012, IEEE Transactions on Mobile Computing.

[16]  Lydia B. Chilton,et al.  The labor economics of paid crowdsourcing , 2010, EC '10.

[17]  Marco Gruteser,et al.  ParkNet: drive-by sensing of road-side parking statistics , 2010, MobiSys '10.

[18]  Deborah Estrin,et al.  Examining micro-payments for participatory sensing data collections , 2010, UbiComp.

[19]  Matthew Lease,et al.  Modeling Temporal Crowd Work Quality with Limited Supervision , 2015, HCOMP.

[20]  Xi Chen,et al.  Spectral Methods Meet EM: A Provably Optimal Algorithm for Crowdsourcing , 2014, J. Mach. Learn. Res..

[21]  F. Pukelsheim The Three Sigma Rule , 1994 .

[22]  Baik Hoh,et al.  Sell your experiences: a market mechanism based incentive for participatory sensing , 2010, 2010 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[23]  Gita Reese Sukthankar,et al.  Improving the Performance of Mobile Phone Crowdsourcing Applications , 2015, AAMAS.

[24]  Sajal K. Das,et al.  Incentive Mechanisms for Participatory Sensing , 2015, ACM Trans. Sens. Networks.

[25]  Romit Roy Choudhury,et al.  SurroundSense: mobile phone localization via ambience fingerprinting , 2009, MobiCom '09.

[26]  Qian Zhang,et al.  Truthful online double auctions for dynamic mobile crowdsourcing , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[27]  Xiang-Yang Li,et al.  How to crowdsource tasks truthfully without sacrificing utility: Online incentive mechanisms with budget constraint , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[28]  Hwee Pink Tan,et al.  Profit-maximizing incentive for participatory sensing , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[29]  Deborah Estrin,et al.  Recruitment Framework for Participatory Sensing Data Collections , 2010, Pervasive.

[30]  Cecilia Mascolo,et al.  ParkSense: a smartphone based sensing system for on-street parking , 2013, MobiCom.

[31]  M. Hansen,et al.  Participatory Sensing , 2019, Internet of Things.

[32]  Prasenjit Dey,et al.  Novel Mechanisms for Online Crowdsourcing with Unreliable, Strategic Agents , 2015, AAAI.

[33]  Lin Gao,et al.  Providing long-term participation incentive in participatory sensing , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[34]  Ramachandran Ramjee,et al.  Nericell: rich monitoring of road and traffic conditions using mobile smartphones , 2008, SenSys '08.

[35]  Aniket Kittur,et al.  A comparison of social, learning, and financial strategies on crowd engagement and output quality , 2014, CSCW.

[36]  James Biagioni,et al.  EasyTracker: automatic transit tracking, mapping, and arrival time prediction using smartphones , 2011, SenSys.

[37]  Iordanis Koutsopoulos,et al.  Optimal incentive-driven design of participatory sensing systems , 2013, 2013 Proceedings IEEE INFOCOM.

[38]  A. P. Dawid,et al.  Maximum Likelihood Estimation of Observer Error‐Rates Using the EM Algorithm , 1979 .

[39]  Chunyan Miao,et al.  Efficient Collaborative Crowdsourcing , 2016, AAAI.

[40]  L. S. Shapley,et al.  17. A Value for n-Person Games , 1953 .

[41]  Man Hon Cheung,et al.  Distributed Time-Sensitive Task Selection in Mobile Crowdsensing , 2015, IEEE Transactions on Mobile Computing.

[42]  J. Rice Mathematical Statistics and Data Analysis , 1988 .

[43]  Anshul Rai,et al.  Zee: zero-effort crowdsourcing for indoor localization , 2012, Mobicom '12.

[44]  Masamichi Shimosaka,et al.  Steered crowdsensing: incentive design towards quality-oriented place-centric crowdsensing , 2014, UbiComp.