The MADLA planner: Multi-agent planning by combination of distributed and local heuristic search

Abstract Real world applications often require cooperation of multiple independent entities. Classical planning is a well established technique solving various challenging problems such as logistic planning, factory process planning, military mission planning and high-level planning for robots. Multi-agent planning aims at solving similar problems in the presence of multiple independent entities (agents). Even though such entities might want to cooperate in order to fulfill a common goal, they may want to keep their internal information and processes private. In such case, we talk about privacy-preserving multi-agent planning. So far, multi-agent planners based on heuristic search used either a local heuristic estimating the particular agent's local subproblem or a distributed heuristic estimating the global problem as a whole. In this paper, we present the Multi-Agent Distributed and Local Asynchronous (MADLA) Planner, running a novel variant of a distributed state-space forward-chaining multi-heuristic search which combines the use of a local and a distributed heuristic in order to combine their benefits. In particular, the planner uses two variants of the well known Fast-Forward heuristic. We provide proofs of soundness and completeness of the search algorithm and show how much and what type of privacy it preserves. We also provide an improved privacy-preserving distribution scheme for the Fast-Forward heuristic. We experimentally compare the newly proposed multi-heuristic scheme and the two used heuristics separately. The results show that the proposed solution outperforms classical (single-heuristic) distributed search with either one of the heuristics used separately. In the detailed experimental analysis, we show limits of the planner and of the used heuristics based on particular properties of the benchmark domains. In a comprehensive set of multi-agent planning domains and problems, we show that the MADLA Planner outperforms all contemporary state-of-the-art privacy-preserving multi-agent planners using a compatible planning model.

[1]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[2]  Eva Onaindia,et al.  An approach to multi-agent planning with incomplete information , 2012, ECAI.

[3]  Joan Feigenbaum,et al.  A new approach to interdomain routing based on secure multi-party computation , 2012, HotNets-XI.

[4]  Andrew Chi-Chih Yao,et al.  How to generate and exchange secrets , 1986, 27th Annual Symposium on Foundations of Computer Science (sfcs 1986).

[5]  Ronen I. Brafman,et al.  From One to Many: Planning for Loosely Coupled Multi-Agent Systems , 2008, ICAPS.

[6]  Ivan Serina,et al.  Plan Stability: Replanning versus Plan Repair , 2006, ICAPS.

[7]  Damien Pellier Distributed Planning through Graph Merging , 2010, ICAART.

[8]  Michal Stolba,et al.  Relaxation Heuristics for Multiagent Planning , 2014, ICAPS.

[9]  Jonas Kvarnström,et al.  Planning for Loosely Coupled Agents Using Partial Order Forward-Chaining , 2010, ICAPS.

[10]  Michael Rovatsos,et al.  Scaling Up Multiagent Planning: A Best-Response Approach , 2011, ICAPS.

[11]  Ronen I. Brafman,et al.  Distributed Heuristic Forward Search for Multi-agent Planning , 2014, J. Artif. Intell. Res..

[12]  Eva Onaindia,et al.  FMAP: Distributed cooperative multi-agent planning , 2014, Applied Intelligence.

[13]  Malte Helmert,et al.  The More, the Merrier: Combining Heuristic Estimators for Satisficing Planning , 2010, ICAPS.

[14]  Ronen I. Brafman,et al.  A general, fully distributed multi-agent planning algorithm , 2010, AAMAS.

[15]  Pavlos Moraitis,et al.  Extending SATPLAN to Multiple Agents , 2010, SGAI Conf..

[16]  Ronen I. Brafman,et al.  Multi-agent A* for parallel and distributed systems , 2012, AAMAS.

[17]  Bernhard Nebel,et al.  The FF Planning System: Fast Plan Generation Through Heuristic Search , 2011, J. Artif. Intell. Res..

[18]  Paolo Traverso,et al.  Automated Planning: Theory & Practice , 2004 .

[19]  Hector Geffner,et al.  Heuristics for Planning with Action Costs Revisited , 2008, ECAI.

[20]  Tom Bylander,et al.  The Computational Complexity of Propositional STRIPS Planning , 1994, Artif. Intell..

[21]  Victor R. Lesser,et al.  Multistage negotiation for distributed constraint satisfaction , 1991, IEEE Trans. Syst. Man Cybern..

[22]  Andrew Coles,et al.  Temporal Planning with Preferences and Time-Dependent Continuous Costs , 2012, ICAPS.

[23]  Leslie Lamport,et al.  Distributed snapshots: determining global states of distributed systems , 1985, TOCS.

[24]  Makoto Yokoo,et al.  Secure Distributed Constraint Satisfaction: Reaching Agreement without Revealing Private Information , 2002, CP.

[25]  Patrik Haslum,et al.  Flexible Abstraction Heuristics for Optimal Sequential Planning , 2007, ICAPS.

[26]  Malte Helmert,et al.  The Fast Downward Planning System , 2006, J. Artif. Intell. Res..

[27]  Loïg Jezequel,et al.  A#: A distributed version of A* for factored planning , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[28]  Michal Stolba,et al.  The International Competition of Distributed and Multiagent Planners (CoDMAP) , 2016, AI Mag..

[29]  Michael Rovatsos,et al.  Automated Agent Decomposition for Classical Planning , 2013, ICAPS.

[30]  Carmel Domshlak,et al.  Landmarks, Critical Paths and Abstractions: What's the Difference Anyway? , 2009, ICAPS.

[31]  Ivan Serina,et al.  LPG: A Planner Based on Local Search for Planning Graphs with Action Costs , 2002, AIPS.

[32]  Jan Jakubuv,et al.  Generating Multi-Agent Plans by Distributed Intersection of Finite State Machines , 2014, ECAI.

[33]  Silvia Richter,et al.  The LAMA Planner: Guiding Cost-Based Anytime Planning with Landmarks , 2010, J. Artif. Intell. Res..

[34]  Patrik Haslum,et al.  Cost-Optimal Factored Planning: Promises and Pitfalls , 2010, ICAPS.

[35]  Shlomi Maliah,et al.  Privacy Preserving Landmark Detection , 2014, ECAI.