Herding the Crowd: Automated Planning for Crowdsourced Planning

An important application of human computation is crowdsourced planning and scheduling. In this paper, we present an architecture for an automated system that can significantly improve the effectiveness of the crowd in collaborating and coming up with effective plans by herding it. We define two main problems that have to be solved when designing such automated crowd-herding systems: interpretation, and steering; and discuss how automated planning techniques can be used to solve these problems.

[1]  Chrysanthos Dellarocas,et al.  Harnessing Crowds: Mapping the Genome of Collective Intelligence , 2009 .

[2]  Peng Dai,et al.  Human Intelligence Needs Artificial Intelligence , 2011, Human Computation.

[3]  Lydia B. Chilton,et al.  Cascade: crowdsourcing taxonomy creation , 2013, CHI.

[4]  Walter S. Lasecki,et al.  Real-Time Collaborative Planning with the Crowd , 2012, AAAI.

[5]  Anand Kulkarni,et al.  Speaking with the crowd , 2012, UIST Adjunct Proceedings '12.

[6]  Dana S. Nau,et al.  SHOP2: An HTN Planning System , 2003, J. Artif. Intell. Res..

[7]  Krzysztof Z. Gajos,et al.  Human computation tasks with global constraints , 2012, CHI.

[8]  Steven Diamond,et al.  TaskGenies: Automatically Providing Action Plans Helps People Complete Tasks , 2012, TCHI.

[9]  Rahul Gupta,et al.  Creating probabilistic databases from information extraction models , 2006, VLDB.

[10]  Been Kim,et al.  Inferring Team Task Plans from Human Meetings: A Generative Modeling Approach with Logic-Based Prior , 2015, J. Artif. Intell. Res..

[11]  Regina Barzilay,et al.  Learning Document-Level Semantic Properties from Free-Text Annotations , 2008, ACL.

[12]  Gautam Biswas,et al.  Interactive task planning under uncertainty and goal changes , 1996, Robotics Auton. Syst..

[13]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[14]  Subbarao Kambhampati,et al.  Generating diverse plans to handle unknown and partially known user preferences , 2012, Artif. Intell..

[15]  Subbarao Kambhampati,et al.  Action-Model Based Multi-agent Plan Recognition , 2012, NIPS.

[16]  Qiang Yang,et al.  Learning action models from plan examples using weighted MAX-SAT , 2007, Artif. Intell..

[17]  Lydia B. Chilton,et al.  Cobi: communitysourcing large-scale conference scheduling , 2013, CHI Extended Abstracts.

[18]  Michael S. Bernstein,et al.  The future of crowd work , 2013, CSCW.

[19]  Daniel Bryce,et al.  Evaluating Temporal Plans in Incomplete Domains , 2012, AAAI.

[20]  J. H. Davis,et al.  TOWARD A STEWARDSHIP THEORY OF MANAGEMENT , 1997 .

[21]  Benjamin B. Bederson,et al.  Human computation: a survey and taxonomy of a growing field , 2011, CHI.

[22]  Jun Zhang,et al.  Simlarity Search for Web Services , 2004, VLDB.

[23]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[24]  Paolo Traverso,et al.  Automated planning - theory and practice , 2004 .

[25]  Henry A. Kautz,et al.  Generalized Plan Recognition , 1986, AAAI.

[26]  Daniel Bryce,et al.  Planning and Acting in Incomplete Domains , 2011, ICAPS.

[27]  James F. Allen,et al.  TRAINS-95: Towards a Mixed-Initiative Planning Assistant , 1996, AIPS.

[28]  Tova Milo,et al.  CrowdPlanr: Planning made easy with crowd , 2013, 2013 IEEE 29th International Conference on Data Engineering (ICDE).

[29]  Krzysztof Z. Gajos,et al.  TurkServer: Enabling Synchronous and Longitudinal Online Experiments , 2012, HCOMP@AAAI.

[30]  Been Kim,et al.  Inferring Robot Task Plans from Human Team Meetings: A Generative Modeling Approach with Logic-Based Prior , 2013, AAAI.

[31]  Peng Dai,et al.  Artificial Intelligence for Artificial Artificial Intelligence , 2011, AAAI.

[32]  Hector Geffner,et al.  Probabilistic Plan Recognition Using Off-the-Shelf Classical Planners , 2010, AAAI.

[33]  Daniel Borrajo,et al.  From Unstructured Web Knowledge to Plan Descriptions , 2011, Information Retrieval and Mining in Distributed Environments.

[34]  Edith Law,et al.  Towards Large-Scale Collaborative Planning: Answering High-Level Search Queries Using Human Computation , 2011, AAAI.

[35]  Matthias Scheutz,et al.  Planning for human-robot teaming in open worlds , 2010, TIST.

[36]  David E. Smith.  Planning as an Iterative Process , 2012, AAAI.

[37]  Eric Horvitz,et al.  Automated Workflow Synthesis , 2013, AAAI.

[38]  Luis von Ahn,et al.  Human computation , 2009, 2009 46th ACM/IEEE Design Automation Conference.

[39]  Subbarao Kambhampati,et al.  Model-lite Planning for the Web Age Masses: The Challenges of Planning with Incomplete and Evolving Domain Models , 2007, AAAI.

[40]  Nathanael Chambers,et al.  PLOW: A Collaborative Task Learning Agent , 2007, AAAI.

[42]  Jim Blythe,et al.  Task learning by instruction in tailor , 2005, IUI.

[43]  Daniel S. Weld,et al.  Temporal Information Extraction , 2010, AAAI.

[44]  Karl Aberer,et al.  On Leveraging Crowdsourcing Techniques for Schema Matching Networks , 2013, DASFAA.