Compositional Synthesis of Reactive Controllers for Multi-agent Systems

In this paper we consider the controller synthesis problem for multi-agent systems that consist of a set of controlled and uncontrolled agents. Controlled agents may need to cooperate with each other and react to the actions of uncontrolled agents in order to fulfill their objectives. Besides, the controlled agents may be imperfect, i.e., only partially observe their environment, for example due to the limitations in their sensors. We propose a framework for controller synthesis based on compositional reactive synthesis. We implement the algorithms symbolically and apply them to a robot motion planning case study where multiple robots are placed on a grid-world with static obstacles and other dynamic, uncontrolled and potentially adversarial robots. We consider different objectives such as collision avoidance, keeping a formation and bounded reachability. We show that by taking advantage of the structure of the system, compositional synthesis algorithm can significantly outperform centralized synthesis approach, both from time and memory perspective, and can solve problems where the centralized algorithm is infeasible. Our findings show the potential of symbolic and compositional reactive synthesis methods as planning algorithms in the presence of dynamically changing and possibly adversarial environment.

[1]  John H. Reif,et al.  The Complexity of Two-Player Games of Incomplete Information , 1984, J. Comput. Syst. Sci..

[2]  Amir Pnueli,et al.  On the synthesis of a reactive module , 1989, POPL '89.

[3]  Krishnendu Chatterjee,et al.  Semiperfect-Information Games , 2005, FSTTCS.

[4]  Stephan Merz,et al.  Model Checking , 2000 .

[5]  Ufuk Topcu,et al.  Distributed power allocation for vehicle management systems , 2011, IEEE Conference on Decision and Control and European Control Conference.

[6]  U. Topcu,et al.  Correct , Reactive Robot Control from Abstraction and Temporal Logic Specifications , 2011 .

[7]  Gerhard Goos,et al.  Automated Technology for Verification and Analysis , 2004, Lecture Notes in Computer Science.

[8]  Ufuk Topcu,et al.  Compositional Synthesis with Parametric Reactive Controllers , 2016, HSCC.

[9]  Amir Pnueli,et al.  Distributed reactive systems are hard to synthesize , 1990, Proceedings [1990] 31st Annual Symposium on Foundations of Computer Science.

[10]  Fabio Somenzi,et al.  An Algorithm for Strongly Connected Component Analysis in n log n Symbolic Steps , 2000, Formal Methods Syst. Des..

[11]  G. Whelan,et al.  Cooperative search and rescue with a team of mobile robots , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[12]  Jean-François Raskin,et al.  Antichains and compositional algorithms for LTL synthesis , 2011, Formal Methods Syst. Des..

[13]  Calin Belta,et al.  Incremental synthesis of control policies for heterogeneous multi-agent systems with linear temporal logic specifications , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Orna Kupferman,et al.  Safraless Compositional Synthesis , 2006, CAV.

[15]  Calin Belta,et al.  Automatic Deployment of Distributed Teams of Robots From Temporal Logic Motion Specifications , 2010, IEEE Transactions on Robotics.

[16]  Ufuk Topcu,et al.  Receding Horizon Temporal Logic Planning , 2012, IEEE Transactions on Automatic Control.

[17]  Krishnendu Chatterjee,et al.  Algorithms for Omega-Regular Games with Imperfect Information, , 2006, CSL.

[18]  Tucker R. Balch,et al.  Behavior-based formation control for multirobot teams , 1998, IEEE Trans. Robotics Autom..

[19]  Bruce Randall Donald,et al.  Moving furniture with teams of autonomous robots , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[20]  Vijay Kumar,et al.  Synthesis of feedback controllers for multiple aerial robots with geometric constraints , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Yoad Lustig,et al.  Synthesis from component libraries , 2009, International Journal on Software Tools for Technology Transfer.

[22]  Krishnendu Chatterjee,et al.  Algorithms for Omega-Regular Games with Imperfect Information , 2006, Log. Methods Comput. Sci..

[23]  Ufuk Topcu,et al.  Pattern-Based Refinement of Assume-Guarantee Specifications in Reactive Synthesis , 2015, TACAS.

[24]  Bernd Finkbeiner,et al.  Bounded synthesis , 2012, International Journal on Software Tools for Technology Transfer.

[25]  Amanda J. C. Sharkey,et al.  Swarm robotics , 2014, Scholarpedia.

[26]  Hadas Kress-Gazit,et al.  Temporal-Logic-Based Reactive Mission and Motion Planning , 2009, IEEE Transactions on Robotics.

[27]  J. Reif,et al.  Lower bounds for multiplayer noncooperative games of incomplete information , 2001 .

[28]  Thomas A. Henzinger,et al.  Alternating-time temporal logic , 1997, Proceedings 38th Annual Symposium on Foundations of Computer Science.

[29]  Christel Baier,et al.  A Compositional Framework for Controller Synthesis , 2011, CONCUR.

[30]  Fabio Somenzi,et al.  Safety first: A two-stage algorithm for LTL games , 2009, 2009 Formal Methods in Computer-Aided Design.

[31]  William B. Dunbar,et al.  Distributed receding horizon control for multi-vehicle formation stabilization , 2006, Autom..

[32]  Amir Pnueli,et al.  Synthesis of Reactive(1) designs , 2006, J. Comput. Syst. Sci..

[33]  Lei Liu,et al.  A Survey of Swarm Robotics System , 2012, ICSI.

[34]  Ufuk Topcu,et al.  Correct, Reactive, High-Level Robot Control: Mitigating the State Explosion Problem of Temporal Logic Synthesis , 2011 .

[35]  Vijay Kumar,et al.  Automated composition of motion primitives for multi-robot systems from safe LTL specifications , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  Rüdiger Ehlers,et al.  Symbolic bounded synthesis , 2010, Formal Methods Syst. Des..

[37]  Francesco Borrelli,et al.  Decentralized receding horizon control for large scale dynamically decoupled systems , 2009, Autom..

[38]  Jean-François Raskin,et al.  A Lattice Theory for Solving Games of Imperfect Information , 2006, HSCC.