Backpropagation for Parametric STL

This paper proposes a method to evaluate Signal Temporal Logic (STL) robustness formulas using computation graphs. This method results in efficient computations and enables the use of backpropagation for optimizing over STL parameters. Inferring STL formulas from behavior traces can provide powerful insights into complex systems, such as longterm behaviors in time-series data. It can also be used to augment existing prediction and planning architectures by ensuring specifications are met. However, learning STL formulas from data is challenging from a theoretical and numerical standpoint. By evaluating and learning STL formulas using computation graphs, we can leverage the computational efficiency and utility of modern machine learning libraries. The proposed approach is particularly effective for solving parameteric STL (pSTL) problems, the problem of parameter fitting for a given signal. We provide a relaxation technique that makes this method tractable when solving general pSTL formulas. Through a traffic-weaving case-study, we show how the proposed approach is effective in learning pSTL parameters, and how it can be applied for scenario-based testing for autonomous driving and other complex robotic systems.

[1]  Randall Balestriero,et al.  Neural Decision Trees , 2017, ArXiv.

[2]  P. Wagner,et al.  Metastable states in a microscopic model of traffic flow , 1997 .

[3]  Calin Belta,et al.  A Decision Tree Approach to Data Classification using Signal Temporal Logic , 2016, HSCC.

[4]  Calin Belta,et al.  Q-Learning for robust satisfaction of signal temporal logic specifications , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[5]  Calin Belta,et al.  Reinforcement learning with temporal logic rewards , 2016, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  Marco Pavone,et al.  Multi-objective optimal control for proactive decision making with temporal logic models , 2019, Int. J. Robotics Res..

[7]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[8]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[9]  Houssam Abbas,et al.  Smooth operator: Control using the smooth robustness of temporal logic , 2017, 2017 IEEE Conference on Control Technology and Applications (CCTA).

[10]  Calin Belta,et al.  Temporal logic inference for classification and prediction from data , 2014, HSCC.

[11]  Thomas Ferrère,et al.  Efficient Parametric Identification for STL , 2018, HSCC.

[12]  Sanjit A. Seshia,et al.  Logical Clustering and Learning for Time-Series Data , 2016, CAV.

[13]  Alberto L. Sangiovanni-Vincentelli,et al.  Model predictive control with signal temporal logic specifications , 2014, 53rd IEEE Conference on Decision and Control.

[14]  Eamonn J. Keogh,et al.  Scaling up dynamic time warping for datamining applications , 2000, KDD '00.

[15]  Jakob Erdmann,et al.  Lane-Changing Model in SUMO , 2014 .

[16]  Calin Belta,et al.  A Policy Search Method For Temporal Logic Specified Reinforcement Learning Tasks , 2017, 2018 Annual American Control Conference (ACC).

[17]  Jonathan A. DeCastro,et al.  Compositional and Contract-Based Verification for Autonomous Driving on Road Networks , 2017, ISRR.

[18]  Dejan Nickovic,et al.  Specification-Based Monitoring of Cyber-Physical Systems: A Survey on Theory, Tools and Applications , 2018, Lectures on Runtime Verification.

[19]  Loo-Nin Teow,et al.  An Effective Learning Method for Max-Min Neural Networks , 1997, IJCAI.

[20]  Marco Pavone,et al.  Multimodal Probabilistic Model-Based Planning for Human-Robot Interaction , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Ashish Kapoor,et al.  Safe Control under Uncertainty with Probabilistic Signal Temporal Logic , 2016, Robotics: Science and Systems.

[22]  Daniel Krajzewicz,et al.  Recent Development and Applications of SUMO - Simulation of Urban MObility , 2012 .

[23]  Yongxin Yang,et al.  Deep Neural Decision Trees , 2018, ArXiv.

[24]  Dejan Nickovic,et al.  Monitoring Temporal Properties of Continuous Signals , 2004, FORMATS/FTRTFT.

[25]  Rupak Majumdar,et al.  Quantifying Conformance Using the Skorokhod Metric , 2015, CAV.

[26]  Dejan Nickovic,et al.  Parametric Identification of Temporal Properties , 2011, RV.

[27]  S. Shankar Sastry,et al.  Stochastic predictive freeway ramp metering from Signal Temporal Logic specifications , 2017, 2017 American Control Conference (ACC).