Spatial Crowdsourcing: Challenges, Techniques, and Applications

Crowdsourcing is a new computing paradigm where humans are actively enrolled to participate in the procedure of computing, especially for tasks that are intrinsically easier for humans than for computers. The popularity of mobile computing and sharing economy has extended conventional web-based crowdsourcing to spatial crowdsourcing (SC), where spatial data such as location, mobility and the associated contextual information, plays a central role. In fact, spatial crowdsourcing has stimulated a series of recent industrial successes including Citizen Sensing (Waze), P2P ride-sharing (Uber) and Real-time Online-To-Offline (O2O) services (Instacart and Postmates). In this tutorial, we review the paradigm shift from web-based crowdsourcing to spatial crowdsourcing. We dive deep into the challenges and techniques brought by the unique spatio-temporal characteristics of spatial crowdsourcing. Particularly, we survey new designs in task assignment, quality control, incentive mechanism design and privacy protection on spatial crowdsourcing platforms, as well as the new trend to incorporate crowdsourcing to enhance existing spatial data processing techniques. We also discuss case studies of representative spatial crowdsourcing systems and raise open questions and current challenges for the audience to easily comprehend the tutorial and to advance this important research area.

[1]  Cyrus Shahabi,et al.  Scalable Spatial Crowdsourcing: A Study of Distributed Algorithms , 2015, 2015 16th IEEE International Conference on Mobile Data Management.

[2]  Lei Chen,et al.  Spatial Crowdsourcing: Challenges and Opportunities , 2016, IEEE Data Eng. Bull..

[3]  Edward Curry,et al.  Efficient task assignment for spatial crowdsourcing: A combinatorial fractional optimization approach with semi-bandit learning , 2016, Expert Syst. Appl..

[4]  Ugur Demiryurek,et al.  Task selection in spatial crowdsourcing from worker’s perspective , 2016, GeoInformatica.

[5]  Divesh Srivastava,et al.  Differentially Private Spatial Decompositions , 2011, 2012 IEEE 28th International Conference on Data Engineering.

[6]  Aditya G. Parameswaran,et al.  Challenges in Data Crowdsourcing , 2016, IEEE Transactions on Knowledge and Data Engineering.

[7]  Robert W. Irving,et al.  The Stable marriage problem - structure and algorithms , 1989, Foundations of computing series.

[8]  Li Xiong,et al.  An Adaptive Approach to Real-Time Aggregate Monitoring With Differential Privacy , 2014, IEEE Trans. Knowl. Data Eng..

[9]  Mani B. Srivastava,et al.  Truth Discovery in Crowdsourced Detection of Spatial Events , 2014, IEEE Transactions on Knowledge and Data Engineering.

[10]  Cyrus Shahabi,et al.  GeoCrowd: enabling query answering with spatial crowdsourcing , 2012, SIGSPATIAL/GIS.

[11]  Christos H. Papadimitriou,et al.  The Euclidean Traveling Salesman Problem is NP-Complete , 1977, Theor. Comput. Sci..

[12]  Lei Chen,et al.  Top-k Team Recommendation in Spatial Crowdsourcing , 2016, WAIM.

[13]  Lei Chen,et al.  Mutual benefit aware task assignment in a bipartite labor market , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[14]  Dirk Van Oudheusden,et al.  The orienteering problem: A survey , 2011, Eur. J. Oper. Res..

[15]  Ugur Demiryurek,et al.  Price-aware real-time ride-sharing at scale: an auction-based approach , 2016, SIGSPATIAL/GIS.

[16]  Philip S. Yu,et al.  On optimal worst-case matching , 2013, SIGMOD '13.

[17]  Guoliang Li,et al.  Crowdsourced Data Management: A Survey , 2016, IEEE Transactions on Knowledge and Data Engineering.

[18]  Cyrus Shahabi,et al.  A Framework for Protecting Worker Location Privacy in Spatial Crowdsourcing , 2014, Proc. VLDB Endow..

[19]  Aditya G. Parameswaran,et al.  Finish Them!: Pricing Algorithms for Human Computation , 2014, Proc. VLDB Endow..

[20]  Panos Kalnis,et al.  Private queries in location based services: anonymizers are not necessary , 2008, SIGMOD Conference.

[21]  Cyrus Shahabi,et al.  Real-time task assignment in hyperlocal spatial crowdsourcing under budget constraints , 2016, 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[22]  Anirban Dasgupta,et al.  Aggregating crowdsourced binary ratings , 2013, WWW.

[23]  Yunhao Liu,et al.  Incentives for Mobile Crowd Sensing: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[24]  Vaidy S. Sunderam,et al.  Participant Privacy in Mobile Crowd Sensing Task Management: A Survey of Methods and Challenges , 2016, SGMD.

[25]  Andreas Krause,et al.  Incentives for Privacy Tradeoff in Community Sensing , 2013, HCOMP.

[26]  Lei Chen,et al.  Whom to Ask? Jury Selection for Decision Making Tasks on Micro-blog Services , 2012, Proc. VLDB Endow..

[27]  Deepak Ganesan,et al.  Labor dynamics in a mobile micro-task market , 2013, CHI.

[28]  Xiaocong Jin,et al.  Privacy-preserving crowdsourced spectrum sensing , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[29]  Kyriakos Mouratidis,et al.  Optimal matching between spatial datasets under capacity constraints , 2010, TODS.

[30]  Raymond Chi-Wing Wong,et al.  On Efficient Spatial Matching , 2007, VLDB.

[31]  Loren G. Terveen,et al.  Avoiding the South Side and the Suburbs: The Geography of Mobile Crowdsourcing Markets , 2015, CSCW.

[32]  Eranda C Ela,et al.  Assignment Problems , 1964, Comput. J..

[33]  Xiang-Yang Li,et al.  How to crowdsource tasks truthfully without sacrificing utility: Online incentive mechanisms with budget constraint , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[34]  Cyrus Shahabi,et al.  A Real-Time Framework for Task Assignment in Hyperlocal Spatial Crowdsourcing , 2017, ACM Trans. Intell. Syst. Technol..

[35]  Ugur Demiryurek,et al.  Maximizing the number of worker's self-selected tasks in spatial crowdsourcing , 2013, SIGSPATIAL/GIS.

[36]  Jizhong Zhao,et al.  Task Assignment on Multi-Skill Oriented Spatial Crowdsourcing , 2015, IEEE Transactions on Knowledge and Data Engineering.

[37]  Beng Chin Ooi,et al.  CDAS: A Crowdsourcing Data Analytics System , 2012, Proc. VLDB Endow..

[38]  Hien To,et al.  Task assignment in spatial crowdsourcing: challenges and approaches , 2016, SIGSPATIAL PhD Symposium.

[39]  Shipeng Yu,et al.  Eliminating Spammers and Ranking Annotators for Crowdsourced Labeling Tasks , 2012, J. Mach. Learn. Res..

[40]  Man Lung Yiu,et al.  Oriented Online Route Recommendation for Spatial Crowdsourcing Task Workers , 2015, SSTD.

[41]  Lei Chen,et al.  gMission: A General Spatial Crowdsourcing Platform , 2014, Proc. VLDB Endow..

[42]  Cyrus Shahabi,et al.  A Server-Assigned Spatial Crowdsourcing Framework , 2015, ACM Trans. Spatial Algorithms Syst..

[43]  Jieping Ye,et al.  Flexible Online Task Assignment in Real-Time Spatial Data , 2017, Proc. VLDB Endow..

[44]  Lei Chen,et al.  Online mobile Micro-Task Allocation in spatial crowdsourcing , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[45]  Panagiotis G. Ipeirotis,et al.  The Dynamics of Micro-Task Crowdsourcing: The Case of Amazon MTurk , 2015, WWW.

[46]  Ming Yin,et al.  Predicting Crowd Work Quality under Monetary Interventions , 2016, HCOMP.

[47]  Mor Naaman,et al.  The motivations and experiences of the on-demand mobile workforce , 2014, CSCW.

[48]  Cyrus Shahabi,et al.  Differentially Private Location Protection for Worker Datasets in Spatial Crowdsourcing , 2017, IEEE Transactions on Mobile Computing.

[49]  Iordanis Koutsopoulos,et al.  Optimal incentive-driven design of participatory sensing systems , 2013, 2013 Proceedings IEEE INFOCOM.

[50]  Lei Chen,et al.  Conflict-aware event-participant arrangement , 2015, 2015 IEEE 31st International Conference on Data Engineering.

[51]  Lei Chen,et al.  Maximizing Acceptance in Rejection-Aware Spatial Crowdsourcing , 2017, IEEE Transactions on Knowledge and Data Engineering.

[52]  Archan Misra,et al.  TASKer: behavioral insights via campus-based experimental mobile crowd-sourcing , 2016, UbiComp.

[53]  Dingqi Yang,et al.  Differential Location Privacy for Sparse Mobile Crowdsensing , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[54]  Kyriakos Mouratidis,et al.  Capacity constrained assignment in spatial databases , 2008, SIGMOD Conference.

[55]  Cyrus Shahabi,et al.  PrivGeoCrowd: A toolbox for studying private spatial Crowdsourcing , 2015, 2015 IEEE 31st International Conference on Data Engineering.

[56]  Lei Chen,et al.  Where To: Crowd-Aided Path Selection , 2014, Proc. VLDB Endow..

[57]  Lei Chen,et al.  Free Market of Crowdsourcing: Incentive Mechanism Design for Mobile Sensing , 2014, IEEE Transactions on Parallel and Distributed Systems.

[58]  Tao Li,et al.  DPSense: Differentially Private Crowdsourced Spectrum Sensing , 2016, CCS.

[59]  Yaron Singer,et al.  Pricing mechanisms for crowdsourcing markets , 2013, WWW.

[60]  Chengyang Zhang,et al.  Map-matching for low-sampling-rate GPS trajectories , 2009, GIS.

[61]  Alexander Maedche,et al.  Gamified crowdsourcing: Conceptualization, literature review, and future agenda , 2017, Int. J. Hum. Comput. Stud..

[62]  Yu Zheng,et al.  Real-Time City-Scale Taxi Ridesharing , 2015, IEEE Transactions on Knowledge and Data Engineering.

[63]  Vaidy S. Sunderam,et al.  Spatial Task Assignment for Crowd Sensing with Cloaked Locations , 2014, 2014 IEEE 15th International Conference on Mobile Data Management.

[64]  Lei Chen,et al.  WiseMarket: a new paradigm for managing wisdom of online social users , 2013, KDD.

[65]  Ming Yin,et al.  Bonus or Not? Learn to Reward in Crowdsourcing , 2015, IJCAI.

[66]  Lei Chen,et al.  GeoTruCrowd: trustworthy query answering with spatial crowdsourcing , 2013, SIGSPATIAL/GIS.

[67]  Chengqi Zhang,et al.  Protecting Location Privacy in Spatial Crowdsourcing using Encrypted Data , 2017, EDBT.

[68]  Michael D. Buhrmester,et al.  Amazon's Mechanical Turk , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[69]  Zhifeng Bao,et al.  Crowdsourced POI labelling: Location-aware result inference and Task Assignment , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[70]  Panagiotis G. Ipeirotis,et al.  Get another label? improving data quality and data mining using multiple, noisy labelers , 2008, KDD.

[71]  Fan Ye,et al.  Mobile crowdsensing: current state and future challenges , 2011, IEEE Communications Magazine.

[72]  Katharina Morik,et al.  Heterogeneous Stream Processing and Crowdsourcing for Urban Traffic Management , 2014, EDBT.

[73]  Jaime Teevan,et al.  Chain Reactions: The Impact of Order on Microtask Chains , 2016, CHI.

[74]  Jiming Chen,et al.  Toward optimal allocation of location dependent tasks in crowdsensing , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[75]  Brent J. Hecht,et al.  A Tale of Cities: Urban Biases in Volunteered Geographic Information , 2014, ICWSM.

[76]  Lei Chen,et al.  Data-driven crowdsourcing: Management, mining, and applications , 2015, 2015 IEEE 31st International Conference on Data Engineering.

[77]  Sihem Amer-Yahia,et al.  A Survey of General-Purpose Crowdsourcing Techniques , 2016, IEEE Transactions on Knowledge and Data Engineering.

[78]  Xiang Lian,et al.  Prediction-Based Task Assignment in Spatial Crowdsourcing , 2015, 2017 IEEE 33rd International Conference on Data Engineering (ICDE).

[79]  Cyrus Shahabi,et al.  MediaQ: mobile multimedia management system , 2014, MMSys '14.

[80]  Lydia B. Chilton,et al.  The labor economics of paid crowdsourcing , 2010, EC '10.

[81]  Zhifeng Bao,et al.  Crowdsourcing-based real-time urban traffic speed estimation: From trends to speeds , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[82]  Ruoming Jin,et al.  Large Scale Real-time Ridesharing with Service Guarantee on Road Networks , 2014, Proc. VLDB Endow..

[83]  Duncan J. Watts,et al.  Financial incentives and the "performance of crowds" , 2009, HCOMP '09.

[84]  Yongxin Tong,et al.  Utility-Aware Event-Participant Planning , 2015 .

[85]  Vaidy S. Sunderam,et al.  Truth Discovery for SpatioTemporal Events from Crowdsourced Data , 2017, Proc. VLDB Endow..

[86]  Jizhong Zhao,et al.  Reliable Diversity-Based Spatial Crowdsourcing by Moving Workers , 2014, Proc. VLDB Endow..

[87]  Xiaofeng Xu,et al.  STAC: spatial task assignment for crowd sensing with cloaked participant locations , 2015, SIGSPATIAL/GIS.

[88]  Lei Chen,et al.  Trichromatic Online Matching in Real-Time Spatial Crowdsourcing , 2017, 2017 IEEE 33rd International Conference on Data Engineering (ICDE).

[89]  Edward Curry,et al.  A Multi-armed Bandit Approach to Online Spatial Task Assignment , 2014, 2014 IEEE 11th Intl Conf on Ubiquitous Intelligence and Computing and 2014 IEEE 11th Intl Conf on Autonomic and Trusted Computing and 2014 IEEE 14th Intl Conf on Scalable Computing and Communications and Its Associated Workshops.

[90]  Han Su,et al.  CrowdPlanner: A Crowd-Based Route Recommendation System , 2013, ArXiv.

[91]  Panagiotis G. Ipeirotis,et al.  Quality management on Amazon Mechanical Turk , 2010, HCOMP '10.

[92]  Andreas Krause,et al.  Truthful incentives in crowdsourcing tasks using regret minimization mechanisms , 2013, WWW.

[93]  Kin K. Leung,et al.  A Survey of Incentive Mechanisms for Participatory Sensing , 2015, IEEE Communications Surveys & Tutorials.

[94]  Lei Chen,et al.  Online Minimum Matching in Real-Time Spatial Data: Experiments and Analysis , 2016, Proc. VLDB Endow..

[95]  Li Xiong,et al.  Protecting Locations with Differential Privacy under Temporal Correlations , 2014, CCS.

[96]  Lei Chen,et al.  Conflict-Aware Event-Participant Arrangement and Its Variant for Online Setting , 2016, IEEE Transactions on Knowledge and Data Engineering.

[97]  Dieter Pfoser,et al.  On Map-Matching Vehicle Tracking Data , 2005, VLDB.

[98]  Cyrus Shahabi,et al.  Task matching and scheduling for multiple workers in spatial crowdsourcing , 2015, SIGSPATIAL/GIS.

[99]  Xiao Han,et al.  Location Privacy-Preserving Task Allocation for Mobile Crowdsensing with Differential Geo-Obfuscation , 2017, WWW.

[100]  Loren G. Terveen,et al.  Towards a Geographic Understanding of the Sharing Economy: Systemic Biases in UberX and TaskRabbit , 2022 .

[101]  Xi Fang,et al.  Crowdsourcing to smartphones: incentive mechanism design for mobile phone sensing , 2012, Mobicom '12.

[102]  Alireza Sahami Shirazi,et al.  Location-based crowdsourcing: extending crowdsourcing to the real world , 2010, NordiCHI.