Campus-Scale Mobile Crowd-Tasking: Deployment & Behavioral Insights

Mobile crowd-tasking markets are growing at an unprecedented rate with increasing number of smartphone users. Such platforms differ from their online counterparts in that they demand physical mobility and can benefit from smartphone processors and sensors for verification purposes. Despite the importance of such mobile crowd-tasking markets, little is known about the labor supply dynamics and mobility patterns of the users. In this paper we design, develop and experiment with a real-world mobile crowd-tasking platform, called TA$Ker. Our contributions are two-fold: (a) We develop TA$Ker, a system that allows us to empirically study the worker responses to push vs. pull strategies for task recommendation and selection. (b) We evaluate our system via experimentation with 80 real users on our campus, over a 4 week period with a corpus of over 1000 tasks. We then provide an in-depth analysis of labor supply, worker behavior & task selection preferences (including the phenomenon of super agents who complete large portions of the tasks) and the efficacy of push-based approaches that recommend tasks based on predicted movement patterns of individual workers.

[1]  Azeem J. Khan,et al.  Experiences with performance tradeoffs in practical, continuous indoor localization , 2013, 2013 IEEE 14th International Symposium on "A World of Wireless, Mobile and Multimedia Networks" (WoWMoM).

[2]  Alireza Sahami Shirazi,et al.  Location-based crowdsourcing: extending crowdsourcing to the real world , 2010, NordiCHI.

[3]  Archan Misra,et al.  LiveLabs: initial reflections on building a large-scale mobile behavioral experimentation testbed , 2013, MOCO.

[4]  Steven Diamond,et al.  TaskGenies: Automatically Providing Action Plans Helps People Complete Tasks , 2012, TCHI.

[5]  Marshall L. Fisher,et al.  An Applications Oriented Guide to Lagrangian Relaxation , 1985 .

[6]  Loren G. Terveen,et al.  Avoiding the South Side and the Suburbs: The Geography of Mobile Crowdsourcing Markets , 2015, CSCW.

[7]  Koustuv Dasgupta,et al.  TRACCS: Trajectory-Aware Coordinated Urban Crowd-Sourcing , 2014 .

[8]  Michael S. Bernstein,et al.  The future of crowd work , 2013, CSCW.

[9]  Subbarao Kambhampati,et al.  Herding the Crowd: Automated Planning for Crowdsourced Planning , 2013, HCOMP.

[10]  Cyrus Shahabi,et al.  GeoCrowd: enabling query answering with spatial crowdsourcing , 2012, SIGSPATIAL/GIS.

[11]  Deepak Ganesan,et al.  Labor dynamics in a mobile micro-task market , 2013, CHI.

[12]  Archan Misra,et al.  Towards City-Scale Mobile Crowdsourcing: Task Recommendations under Trajectory Uncertainties , 2015, IJCAI.

[13]  Panagiotis G. Ipeirotis,et al.  Estimating the Completion Time of Crowdsourced Tasks Using Survival Analysis Models , 2011 .