From Uncertainty Data to Robust Policies for Temporal Logic Planning

We consider the problem of synthesizing robust disturbance feedback policies for systems performing complex tasks. We formulate the tasks as linear temporal logic specifications and encode them into an optimization framework via mixed-integer constraints. Both the system dynamics and the specifications are known but affected by uncertainty. The distribution of the uncertainty is unknown, however realizations can be obtained. We introduce a data-driven approach where the constraints are fulfilled for a set of realizations and provide probabilistic generalization guarantees as a function of the number of considered realizations. We use separate chance constraints for the satisfaction of the specification and operational constraints. This allows us to quantify their violation probabilities independently. We compute disturbance feedback policies as solutions of mixed-integer linear or quadratic optimization problems. By using feedback we can exploit information of past realizations and provide feasibility for a wider range of situations compared to static input sequences. We demonstrate the proposed method on two robust motion-planning case studies for autonomous driving.

[1]  John Lygeros,et al.  Control synthesis for stochastic systems given automata specifications defined by stochastic sets , 2017, Autom..

[2]  Christel Baier,et al.  Principles of model checking , 2008 .

[3]  Dimitris Bertsimas,et al.  Binary decision rules for multistage adaptive mixed-integer optimization , 2018, Math. Program..

[4]  Rupak Majumdar,et al.  Shrinking Horizon Model Predictive Control with chance-constrained signal temporal logic specifications , 2017, 2017 American Control Conference (ACC).

[5]  Panos J. Antsaklis Editorial Marking the 60th Anniversary of TAC: A Success Story , 2015, IEEE Trans. Autom. Control..

[6]  Marco C. Campi,et al.  Wait-and-judge scenario optimization , 2016, Mathematical Programming.

[7]  J. Lofberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004, 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No.04CH37508).

[8]  Ricardo G. Sanfelice,et al.  Optimal control of Mixed Logical Dynamical systems with Linear Temporal Logic specifications , 2008, 2008 47th IEEE Conference on Decision and Control.

[9]  Shuaian Wang,et al.  Sample Average Approximation , 2018 .

[10]  John Lygeros,et al.  Performance Bounds for the Scenario Approach and an Extension to a Class of Non-Convex Programs , 2013, IEEE Transactions on Automatic Control.

[11]  Sanjit A. Seshia,et al.  Reactive synthesis from signal temporal logic specifications , 2015, HSCC.

[12]  Viktor Schuppan,et al.  Linear Encodings of Bounded LTL Model Checking , 2006, Log. Methods Comput. Sci..

[13]  Maryam Kamgarpour,et al.  Robust Control Policies Given Formal Specifications in Uncertain Environments , 2017, IEEE Control Systems Letters.

[14]  Iain Dunning,et al.  Multistage Robust Mixed-Integer Optimization with Adaptive Partitions , 2016, Oper. Res..

[15]  Calin Belta,et al.  Temporal logic inference for classification and prediction from data , 2014, HSCC.

[16]  Giuseppe Carlo Calafiore,et al.  Random Convex Programs , 2010, SIAM J. Optim..

[17]  Alberto Bemporad,et al.  Control of systems integrating logic, dynamics, and constraints , 1999, Autom..

[18]  G. Calafiore,et al.  On mixed-integer random convex programs , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[19]  Calin Belta,et al.  Temporal logic model predictive control , 2015, Autom..

[20]  George J. Pappas,et al.  Hybrid Controllers for Path Planning: A Temporal Logic Approach , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[21]  Fred Kröger,et al.  Temporal Logic of Programs , 1987, EATCS Monographs on Theoretical Computer Science.

[22]  Vasumathi Raman,et al.  Robust Model Predictive Control for Signal Temporal Logic Synthesis , 2015, ADHS.

[23]  Calin Belta,et al.  Temporal Logic Motion Planning and Control With Probabilistic Satisfaction Guarantees , 2012, IEEE Transactions on Robotics.

[24]  Sergio Grammatico,et al.  On the sample size of random convex programs with structured dependence on the uncertainty , 2015, Autom..

[25]  Eric C. Kerrigan,et al.  Optimization over state feedback policies for robust control with constraints , 2006, Autom..

[26]  Christel Baier,et al.  Principles of Model Checking (Representation and Mind Series) , 2008 .

[27]  John Lygeros,et al.  Control design for specifications on stochastic hybrid systems , 2013, HSCC '13.

[28]  John Lygeros,et al.  On the Road Between Robust Optimization and the Scenario Approach for Chance Constrained Optimization Problems , 2014, IEEE Transactions on Automatic Control.

[29]  Marco C. Campi,et al.  The Exact Feasibility of Randomized Solutions of Uncertain Convex Programs , 2008, SIAM J. Optim..

[30]  Jean-Philippe Vial,et al.  Robust Optimization , 2021, ICORES.

[31]  Paulo Tabuada,et al.  Linear Time Logic Control of Discrete-Time Linear Systems , 2006, IEEE Transactions on Automatic Control.

[32]  Ufuk Topcu,et al.  Optimization-based trajectory generation with linear temporal logic specifications , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Ufuk Topcu,et al.  Robust control of uncertain Markov Decision Processes with temporal logic specifications , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[34]  Sergio Grammatico,et al.  A Scenario Approach for Non-Convex Control Design , 2014, IEEE Transactions on Automatic Control.

[35]  Dick den Hertog,et al.  Multistage Adjustable Robust Mixed-Integer Optimization via Iterative Splitting of the Uncertainty Set , 2016, INFORMS J. Comput..

[36]  Calin Belta,et al.  LTL Control in Uncertain Environments with Probabilistic Satisfaction Guarantees , 2011, ArXiv.

[37]  Hadas Kress-Gazit,et al.  Temporal-Logic-Based Reactive Mission and Motion Planning , 2009, IEEE Transactions on Robotics.

[38]  Ashish Kapoor,et al.  Safe Control under Uncertainty with Probabilistic Signal Temporal Logic , 2016, Robotics: Science and Systems.

[39]  Lorenzo Fagiano,et al.  Randomized Solutions to Convex Programs with Multiple Chance Constraints , 2012, SIAM J. Optim..

[40]  Johan Efberg,et al.  YALMIP : A toolbox for modeling and optimization in MATLAB , 2004 .

[41]  L. Williams,et al.  Contents , 2020, Ophthalmology (Rochester, Minn.).