Learning-based formal synthesis of cooperative multi-agent systems with an application to robotic coordination

In our previous work [4], we proposed a learning-based formal top-down design framework to automatically synthesize coordination and control strategies for cooperative multi-agent systems. Our main idea is to decompose a given team mission into individual local tasks and synthesizing local supervisors while guarantee the multi-agent performance by incorporating supervisor synthesis with compositional verification techniques. In this paper, we apply the top-down design framework to a multi-robot scenario that involves both request-response services and multi-robot coordination. Modified L* algorithms are adapted to both the local synthesis and the compositional verification to ensure that the collective behavior of the robots will eventually guarantee the satisfaction of the global specification. Computational and software tools are developed to integrate automatic supervisor synthesis and interrobot communication.

[1]  Hai Lin,et al.  Automatic synthesis of cooperative multi-agent systems , 2014, 53rd IEEE Conference on Decision and Control.

[2]  Makoto Yokoo,et al.  Coordination Planning: Applying Control Synthesis Methods for a Class of Distributed Agents , 2009, IEEE Transactions on Control Systems Technology.

[3]  Dimos V. Dimarogonas,et al.  Multi-agent planning under local LTL specifications and event-based synchronization , 2016, Autom..

[4]  Christos G. Cassandras,et al.  Introduction to Discrete Event Systems , 1999, The Kluwer International Series on Discrete Event Dynamic Systems.

[5]  Yushan Chen,et al.  Temporal logic robot control based on automata learning of environmental dynamics , 2013, Int. J. Robotics Res..

[6]  Petros G. Voulgaris,et al.  Distributed Coordination Control for Multi-Robot Networks Using Lyapunov-Like Barrier Functions , 2016, IEEE Transactions on Automatic Control.

[7]  Hadas Kress-Gazit,et al.  Temporal-Logic-Based Reactive Mission and Motion Planning , 2009, IEEE Transactions on Robotics.

[8]  Calin Belta,et al.  A Fully Automated Framework for Control of Linear Systems from Temporal Logic Specifications , 2008, IEEE Transactions on Automatic Control.

[9]  Hai Lin,et al.  Guaranteed global performance through local coordinations , 2011, Autom..

[10]  Howard Barringer,et al.  Learning to divide and conquer: applying the L* algorithm to automate assume-guarantee reasoning , 2008, Formal Methods Syst. Des..

[11]  Hai Lin,et al.  Formal design of robot Integrated Task and Motion Planning , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[12]  Kimon P. Valavanis Intelligent Robotic Systems: Theory, Design and Applications , 1995, ICCCN.

[13]  Hervé Marchand,et al.  Supervisory control of concurrent discrete event systems , 2004 .

[14]  Herbert G. Tanner,et al.  Flocking, Formation Control, and Path Following for a Group of Mobile Robots , 2015, IEEE Transactions on Control Systems Technology.

[15]  Hadas Kress-Gazit,et al.  Iterative Temporal Planning in Uncertain Environments With Partial Satisfaction Guarantees , 2016, IEEE Transactions on Robotics.

[16]  Rong Su,et al.  On Distributed and Parameterized Supervisor Synthesis Problems , 2016, IEEE Transactions on Automatic Control.

[17]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[18]  Hadas Kress-Gazit,et al.  Where's Waldo? Sensor-Based Temporal Logic Motion Planning , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[19]  AngluinDana Learning regular sets from queries and counterexamples , 1987 .

[20]  Jana Kosecka,et al.  Control of Discrete Event Systems , 1992 .

[21]  Antonio Bicchi,et al.  Symbolic planning and control of robot motion [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[22]  Calin Belta,et al.  Automatic Deployment of Distributed Teams of Robots From Temporal Logic Motion Specifications , 2010, IEEE Transactions on Robotics.

[23]  Robi Malik,et al.  Incremental verification and synthesis of discrete-event systems guided by counter examples , 2004, IEEE Transactions on Control Systems Technology.

[24]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[25]  Vijay K. Garg,et al.  Modeling and Control of Logical Discrete Event Systems , 1994 .

[26]  Weihua Sheng,et al.  Multirobot Cooperative Learning for Predator Avoidance , 2015, IEEE Transactions on Control Systems Technology.

[27]  Francisco José Madrid-Cuevas,et al.  Generation of fiducial marker dictionaries using Mixed Integer Linear Programming , 2016, Pattern Recognit..

[28]  Matthew J. Rutherford,et al.  Enabling intelligent unmanned vehicles through XMOS Technology , 2012 .

[29]  Christel Baier,et al.  Principles of model checking , 2008 .

[30]  Jason R. Marden,et al.  Cooperative Control and Potential Games , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[31]  D. Dimarogonas,et al.  Decentralized multi-agent control from local LTL specifications , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[32]  Yushan Chen,et al.  Automatic Deployment of Robotic Teams , 2011, IEEE Robotics & Automation Magazine.

[33]  Dana Angluin,et al.  Learning Regular Sets from Queries and Counterexamples , 1987, Inf. Comput..

[34]  Yushan Chen,et al.  Formal Approach to the Deployment of Distributed Robotic Teams , 2012, IEEE Transactions on Robotics.

[35]  Dimos V. Dimarogonas,et al.  Multi-agent plan reconfiguration under local LTL specifications , 2015, Int. J. Robotics Res..

[36]  Paulo Tabuada,et al.  Linear Time Logic Control of Discrete-Time Linear Systems , 2006, IEEE Transactions on Automatic Control.

[37]  Dimos V. Dimarogonas,et al.  On the Rendezvous Problem for Multiple Nonholonomic Agents , 2007, IEEE Transactions on Automatic Control.

[38]  P. Ramadge,et al.  Supervisory control of a class of discrete event processes , 1987 .

[39]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.