Multi-Agent Planning by Plan Set Intersection

Faculty of Electrical Engineering Department or Computer Science Doctor of Philosophy Multi-Agent Planning by Plan Set Intersection by RNDr. Jan TOŽIČKA Coordination of a team of cooperative agents and their activities towards fulfillment of goals is described by multi-agent planning. For deterministic environments, where agents are not willing to share all their knowledge, the MA-STRIPS model provides minimal extension from classical planning. MA-STRIPS exactly prescribes what information can be freely communicated between the agents and what information has to be kept private such that the shared or individual goals can be still achieved. This thesis proposes a novel multi-agent planning approach which distributively intersects local plans of the agents towards a global solution of the multi-agent planning problem. This core principle builds on local compilation to a classical planning problem and compact representation of the local plans in the form of Finite State Machines. The efficiency of the resulting planner is further boosted up by distributed delete-relaxation heuristic, an approximative local plan analysis, and reduction of agents’ internal problems. The planning approach is analysed theoretically, in particular we prove its completeness and soundness. Experimental evaluation shows its applicability in a full privacy setting where only public information can be communicated and in less restricted privacy settings. At a recent international competition of distributed multiagent planners, the proposed planner showed top performance when compared with other existing state-of-the-art multi-agent planners.

[1]  Ronen I. Brafman,et al.  Multi-agent A* for parallel and distributed systems , 2012, AAMAS.

[2]  Ronen I. Brafman,et al.  Partial-Order Planning with Concurrent Interacting Actions , 2011, J. Artif. Intell. Res..

[3]  Earl D. Sacerdott Planning in a hierarchy of abstraction spaces , 1973, IJCAI 1973.

[4]  Qiang Yang,et al.  Downward Refinement and the Efficiency of Hierarchical Problem Solving , 1994, Artif. Intell..

[5]  Blai Bonet,et al.  Planning as heuristic search , 2001, Artif. Intell..

[6]  Jan Jakubuv,et al.  Extensibility Based Multiagent Planner with Plan Diversity Metrics , 2015, Trans. Comput. Collect. Intell..

[7]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[8]  Michal Stolba,et al.  Competition of Distributed and Multiagent Planners (CoDMAP) , 2016, AAAI.

[9]  Bart Selman,et al.  Encoding Plans in Propositional Logic , 1996, KR.

[10]  Ronen I. Brafman,et al.  From One to Many: Planning for Loosely Coupled Multi-Agent Systems , 2008, ICAPS.

[11]  Eva Onaindia,et al.  A flexible coupling approach to multi-agent planning under incomplete information , 2015, Knowledge and Information Systems.

[12]  Michael Rovatsos,et al.  Scaling Up Multiagent Planning: A Best-Response Approach , 2011, ICAPS.

[13]  Damien Pellier Distributed Planning through Graph Merging , 2010, ICAART.

[14]  Eva Onaindia,et al.  FMAP: Distributed cooperative multi-agent planning , 2014, Applied Intelligence.

[15]  Ronen I. Brafman,et al.  A general, fully distributed multi-agent planning algorithm , 2010, AAMAS.

[16]  Joe B. Wells,et al.  Instant Polymorphic Type Systems for Mobile Process Calculi: Just Add Reduction Rules and Close , 2005, ESOP.

[17]  Ronen I. Brafman,et al.  A Privacy Preserving Algorithm for Multi-Agent Planning and Search , 2015, IJCAI.

[18]  Olivier Buffet,et al.  Factored Planning Using Decomposition Trees , 2007, IJCAI.

[19]  Michal Pechoucek,et al.  Privacy-concerned multiagent planning , 2015, Knowledge and Information Systems.

[20]  A. Cesta,et al.  CSTRIPS : Toward Explicit Concurrent Planning , 2004 .

[21]  Paolo Traverso,et al.  Automated planning - theory and practice , 2004 .

[22]  Christer Bäckström,et al.  Tractable plan existence does not imply tractable plan generation , 2004, Annals of Mathematics and Artificial Intelligence.

[23]  Patrik Haslum,et al.  Flexible Abstraction Heuristics for Optimal Sequential Planning , 2007, ICAPS.

[24]  Avrim Blum,et al.  Fast Planning Through Planning Graph Analysis , 1995, IJCAI.

[25]  Eric Allender,et al.  Complexity of finite-horizon Markov decision process problems , 2000, JACM.

[26]  Tom Bylander,et al.  The Computational Complexity of Propositional STRIPS Planning , 1994, Artif. Intell..

[27]  Manuela M. Veloso,et al.  OBDD-based Universal Planning for Synchronized Agents in Non-Deterministic Domains , 2000, J. Artif. Intell. Res..

[28]  E. H. Clarke Multipart pricing of public goods , 1971 .

[29]  Theodore Groves,et al.  Incentives in Teams , 1973 .

[30]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[31]  R. Rosenthal A class of games possessing pure-strategy Nash equilibria , 1973 .

[32]  Michael Brenner,et al.  Multiagent Planning with Partially Ordered Temporal Plans , 2003, IJCAI.

[33]  Lukás Chrpa,et al.  Generation of macro-operators via investigation of action dependencies in plans , 2010, The Knowledge Engineering Review.

[34]  Joe B. Wells,et al.  Expressiveness of Generic Process Shape Types , 2010, TGC.

[35]  Michal Pechoucek,et al.  Multiagent Planning Supported by Plan Diversity Metrics and Landmark Actions , 2014, ICAART.

[36]  Loïg Jezequel,et al.  A#: A distributed version of A* for factored planning , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[37]  Subhrajit Bhattacharya,et al.  Search-Based Path Planning with Homotopy Class Constraints in 3D , 2010, AAAI.

[38]  Jan Jakubuv,et al.  Recursive Reductions of Internal Dependencies in Multiagent Planning , 2016, ICAART.

[39]  Jan Jakubuv,et al.  Generating Multi-Agent Plans by Distributed Intersection of Finite State Machines , 2014, ECAI.

[40]  Patrik Haslum,et al.  Cost-Optimal Factored Planning: Promises and Pitfalls , 2010, ICAPS.

[41]  Jan Jakubuv,et al.  Recursive Polynomial Reductions for Classical Planning , 2016, ICAPS.

[42]  Michal Stolba,et al.  Relaxation Heuristics for Multiagent Planning , 2014, ICAPS.

[43]  Eyal Amir,et al.  Factored planning , 2003, IJCAI 2003.

[44]  Ronen I. Brafman,et al.  Factored Planning: How, When, and When Not , 2006, AAAI.

[45]  Amy L. Lansky,et al.  Scope and Abstraction: Two Criteria for Localized Planning , 1995, IJCAI.

[46]  Hiroaki Kitano,et al.  RoboCup Rescue: search and rescue in large-scale disasters as a domain for autonomous agents research , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[47]  Jan Jakubuv,et al.  Multiagent Planning by Plan Set Intersection and Plan Verification , 2015, ICAART.

[48]  Pavlos Moraitis,et al.  Extending SATPLAN to Multiple Agents , 2010, SGAI Conf..

[49]  Karel Durkota,et al.  Deterministic Multiagent Planning Techniques : Experimental Comparison ( Short paper ) , 2013 .

[50]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[51]  Bernhard Nebel,et al.  The FF Planning System: Fast Plan Generation Through Heuristic Search , 2011, J. Artif. Intell. Res..

[52]  Allen Newell,et al.  Report on a general problem-solving program , 1959, IFIP Congress.

[53]  Mark Hopkins,et al.  Using Recursive Decomposition to Construct Elimination Orders, Jointrees, and Dtrees , 2001, ECSQARU.

[54]  Shlomi Maliah,et al.  Privacy Preserving Landmark Detection , 2014, ECAI.