Incremental synthesis of control policies for heterogeneous multi-agent systems with linear temporal logic specifications

We consider automatic synthesis of control policies for non-independent, heterogeneous multi-agent systems with the objective of maximizing the probability of satisfying a given specification. The specification is expressed as a formula in linear temporal logic. The agents are modeled by Markov decision processes with a common set of actions. These actions, however, may or may not affect the behaviors of all the agents. To alleviate the well-known state explosion problem, an incremental approach is proposed where only a small subset of agents is incorporated in the synthesis procedure initially and more agents are successively added until the limitations on computational resources are reached. The proposed algorithm runs in an anytime fashion, where the probability of satisfying the specification increases as the algorithm progresses.

[1]  D.M. Tilbury,et al.  Modular Supervisory Control of Discrete-Event Systems with Abstraction and Incremental Hierarchical Construction , 2006, 2006 8th International Workshop on Discrete Event Systems.

[2]  U. Topcu,et al.  Correct , Reactive Robot Control from Abstraction and Temporal Logic Specifications , 2011 .

[3]  Ufuk Topcu,et al.  Correct, Reactive, High-Level Robot Control , 2011, IEEE Robotics & Automation Magazine.

[4]  Christel Baier,et al.  Principles of Model Checking (Representation and Mind Series) , 2008 .

[5]  Hadas Kress-Gazit,et al.  Temporal Logic Motion Planning for Mobile Robots , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[6]  Calin Belta,et al.  Temporal logic control in dynamic environments with probabilistic satisfaction guarantees , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Kiam Tian Seow,et al.  A dynamic programming approach to multi-level supervision , 2009, 2009 IEEE International Conference on Robotics and Automation.

[8]  Hadas Kress-Gazit,et al.  Where's Waldo? Sensor-Based Temporal Logic Motion Planning , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[9]  Calin Belta,et al.  LTL Control in Uncertain Environments with Probabilistic Satisfaction Guarantees , 2011, ArXiv.

[10]  Christel Baier,et al.  PROBMELA: a modeling language for communicating probabilistic processes , 2004, Proceedings. Second ACM and IEEE International Conference on Formal Methods and Models for Co-Design, 2004. MEMOCODE '04..

[11]  C. Baier,et al.  Experiments with Deterministic ω-Automata for Formulas of Linear Temporal Logic , 2005 .

[12]  Calin Belta,et al.  Incremental temporal logic synthesis of control policies for robots interacting with dynamic agents , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Hongyang Qu,et al.  Incremental quantitative verification for Markov decision processes , 2011, 2011 IEEE/IFIP 41st International Conference on Dependable Systems & Networks (DSN).

[14]  Hadas Kress-Gazit,et al.  Valet parking without a valet , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Yushan Chen,et al.  Synthesis of distributed control and communication schemes from global LTL specifications , 2011, IEEE Conference on Decision and Control and European Control Conference.

[16]  E. Allen Emerson,et al.  Temporal and Modal Logic , 1991, Handbook of Theoretical Computer Science, Volume B: Formal Models and Sematics.

[17]  Zohar Manna,et al.  The Temporal Logic of Reactive and Concurrent Systems , 1991, Springer New York.

[18]  William J. Mitchell,et al.  Reinventing the Automobile: Personal Urban Mobility for the 21st Century , 2010 .

[19]  Calin Belta,et al.  Incremental control synthesis in probabilistic environments with Temporal Logic constraints , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[20]  Antonio Bicchi,et al.  Symbolic planning and control of robot motion [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[21]  Emilio Frazzoli,et al.  Synthesis of provably correct controllers for autonomous vehicles in urban environments , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[22]  Emilio Frazzoli,et al.  Sampling-based motion planning with deterministic μ-calculus specifications , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[23]  Lydia E. Kavraki,et al.  Sampling-based motion planning with temporal goals , 2010, 2010 IEEE International Conference on Robotics and Automation.

[24]  Robi Malik,et al.  Incremental verification and synthesis of discrete-event systems guided by counter examples , 2004, IEEE Transactions on Control Systems Technology.

[25]  Ufuk Topcu,et al.  Distributed Synthesis of Control Protocols for Smart Camera Networks , 2011, 2011 IEEE/ACM Second International Conference on Cyber-Physical Systems.

[26]  Christel Baier,et al.  Reduction Techniques for Model Checking Markov Decision Processes , 2008, 2008 Fifth International Conference on Quantitative Evaluation of Systems.