FMAP: Distributed cooperative multi-agent planning

This paper proposes FMAP (Forward Multi-Agent Planning), a fully-distributed multi-agent planning method that integrates planning and coordination. Although FMAP is specifically aimed at solving problems that require cooperation among agents, the flexibility of the domain-independent planning model allows FMAP to tackle multi-agent planning tasks of any type. In FMAP, agents jointly explore the plan space by building up refinement plans through a complete and flexible forward-chaining partial-order planner. The search is guided by hDTG, a novel heuristic function that is based on the concepts of Domain Transition Graph and frontier state and is optimized to evaluate plans in distributed environments. Agents in FMAP apply an advanced privacy model that allows them to adequately keep private information while communicating only the data of the refinement plans that is relevant to each of the participating agents. Experimental results show that FMAP is a general-purpose approach that efficiently solves tightly-coupled domains that have specialized agents and cooperative goals as well as loosely-coupled problems. Specifically, the empirical evaluation shows that FMAP outperforms current MAP systems at solving complex planning tasks that are adapted from the International Planning Competition benchmarks.

[1]  Malte Helmert,et al.  A Planning Heuristic Based on Causal Graph Analysis , 2004, ICAPS.

[2]  Roman van der Krogt Quantifying privacy in multiagent planning , 2009, Multiagent Grid Syst..

[3]  Anupam Shukla,et al.  Communication constraints multi-agent territory exploration task , 2012, Applied Intelligence.

[4]  Victor R. Lesser Evolution of the GPGP/TÆMS domain-independent coordination framework , 2002, AAMAS.

[5]  Jose M. Such,et al.  Strategies for avoiding preference profiling in agent-based e-commerce environments , 2013, Applied Intelligence.

[6]  Odd Erik Gundersen,et al.  A multiagent framework for coordinated parallel problem solving , 2008, Applied Intelligence.

[7]  Malik Ghallab,et al.  Chapter 14 – Temporal Planning , 2004 .

[8]  Bernhard Nebel,et al.  Continual planning and acting in dynamic multiagent environments , 2006 .

[9]  Bernhard Nebel,et al.  The FF Planning System: Fast Plan Generation Through Heuristic Search , 2011, J. Artif. Intell. Res..

[10]  Victor R. Lesser,et al.  Evolution of the GPGP/TÆMS Domain-Independent Coordination Framework , 2002, AAMAS '02.

[11]  Mathijs de Weerdt,et al.  Introduction to planning in multiagent systems , 2009, Multiagent Grid Syst..

[12]  Jian Feng Zhang,et al.  Graph-based multiagent replanning algorithm , 2007, AAMAS '07.

[13]  Andrew Coles,et al.  Temporal Planning with Preferences and Time-Dependent Continuous Costs , 2012, ICAPS.

[14]  Paolo Traverso,et al.  Automated Planning: Theory & Practice , 2004 .

[15]  Thomas Dean,et al.  Automated planning , 1996, CSUR.

[16]  Daniel Borrajo,et al.  A case-based approach to heuristic planning , 2013, Applied Intelligence.

[17]  David E. Smith,et al.  Planning Under Continuous Time and Resource Uncertainty: A Challenge for AI , 2002, AIPS Workshop on Planning for Temporal Domains.

[18]  Cees Witteveen,et al.  Plan coordination by revision in collective agent based systems , 2002, Artif. Intell..

[19]  Eva Onaindia,et al.  A distributed CSP approach for collaborative planning systems , 2008, Eng. Appl. Artif. Intell..

[20]  Mathijs de Weerdt,et al.  Plan Repair as an Extension of Planning , 2005, ICAPS.

[21]  Kevin Warwick,et al.  Dynamic distributed lanes: motion planning for multiple autonomous vehicles , 2014, Applied Intelligence.

[22]  Eva Onaindia,et al.  Planning in highly dynamic environments: an anytime approach for planning under time constraints , 2007, Applied Intelligence.

[23]  Daniel Borrajo Multi-agent planning by plan reuse , 2013, AAMAS.

[24]  Jose M. Such,et al.  Magentix2: A privacy-enhancing Agent Platform , 2013, Eng. Appl. Artif. Intell..

[25]  Eva Onaindia,et al.  A flexible coupling approach to multi-agent planning under incomplete information , 2015, Knowledge and Information Systems.

[26]  Silvia Richter,et al.  The LAMA Planner: Guiding Cost-Based Anytime Planning with Landmarks , 2010, J. Artif. Intell. Res..

[27]  Patrik Haslum,et al.  Deterministic planning in the fifth international planning competition: PDDL3 and experimental evaluation of the planners , 2009, Artif. Intell..

[28]  Jian Feng Zhang,et al.  Graph-based Multi-agent Replanning Algorithm , 2007 .

[29]  Ronen I. Brafman,et al.  A general, fully distributed multi-agent planning algorithm , 2010, AAMAS.

[30]  Pavlos Moraitis,et al.  μ-SATPLAN: Multi-agent planning as satisfiability , 2012, Knowl. Based Syst..

[31]  Jonas Kvarnström,et al.  Planning for Loosely Coupled Agents Using Partial Order Forward-Chaining , 2010, ICAPS.

[32]  Paolo Traverso,et al.  Automated planning - theory and practice , 2004 .

[33]  P. D. O'Brien,et al.  FIPA — Towards a Standard for Software Agents , 1998 .

[34]  Makoto Yokoo,et al.  The Distributed Constraint Satisfaction Problem: Formalization and Algorithms , 1998, IEEE Trans. Knowl. Data Eng..

[35]  Michael Rovatsos,et al.  Automated Agent Decomposition for Classical Planning , 2013, ICAPS.

[36]  Michael Rovatsos,et al.  Scaling Up Multiagent Planning: A Best-Response Approach , 2011, ICAPS.

[37]  Ronen I. Brafman,et al.  Partial-Order Planning with Concurrent Interacting Actions , 2011, J. Artif. Intell. Res..

[38]  Edmund H. Durfee,et al.  Efficient and distributable methods for solving the multiagent plan coordination problem , 2009, Multiagent Grid Syst..

[39]  David E. Smith,et al.  Bridging the gap between planning and scheduling , 2000, The Knowledge Engineering Review.

[40]  Ronen I. Brafman,et al.  From One to Many: Planning for Loosely Coupled Multi-Agent Systems , 2008, ICAPS.

[41]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[42]  Eva Onaindia,et al.  An approach to multi-agent planning with incomplete information , 2012, ECAI.

[43]  M. Fox,et al.  The 3rd International Planning Competition: Results and Analysis , 2003, J. Artif. Intell. Res..

[44]  Jana Koehler,et al.  An AI-Based Approach to Destination Control in Elevators , 2002, AI Mag..

[45]  Dietmar Jannach,et al.  Modeling and Solving Distributed Configuration Problems: A CSP-Based Approach , 2013, IEEE Transactions on Knowledge and Data Engineering.

[46]  Pinar Yolum,et al.  Constraint satisfaction as a tool for modeling and checking feasibility of multiagent commitments , 2013, Applied Intelligence.