Active Learning of Signal Temporal Logic Specifications

In this paper, we propose a method to infer temporal logic behaviour models of an a priori unknown system. We use the formalism of Signal Temporal Logic (STL), which can express various robot motion planning and control specifications, including spatial preferences. In our setting, data is collected through a series of queries the learning algorithm poses to the system under test. This active learning approach incrementally builds a hypothesis solution which, over time, converges to the actual behaviour of the system. Active learning presents several benefits compared to supervised learning: in the case of costly prior labelling of data, and if the system to test is accessible, the learning algorithm can interact with the system to refine its guess of the specification of the system. Inspired by mobile robot navigation tasks, we present experimental case studies to ensure the relevance of our method.

[1]  Thomas Ferrère,et al.  Efficient Parametric Identification for STL , 2018, HSCC.

[2]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[3]  Calin Belta,et al.  Temporal Logics for Learning and Detection of Anomalous Behavior , 2017, IEEE Transactions on Automatic Control.

[4]  Calin Belta,et al.  Metrics for Signal Temporal Logic Formulae , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[5]  Calin Belta,et al.  A Decision Tree Approach to Data Classification using Signal Temporal Logic , 2016, HSCC.

[6]  Hadas Kress-Gazit,et al.  LTLMoP: Experimenting with language, Temporal Logic and robot control , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Dejan Nickovic,et al.  Monitoring Temporal Properties of Continuous Signals , 2004, FORMATS/FTRTFT.

[8]  Ezio Bartocci,et al.  A Robust Genetic Algorithm for Learning Temporal Specifications from Data , 2018, QEST.

[9]  Vasumathi Raman,et al.  Sampling-based synthesis of maximally-satisfying controllers for temporal logic specifications , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Sanjit A. Seshia,et al.  Logical Clustering and Learning for Time-Series Data , 2016, 1612.07823.

[11]  Dejan Nickovic,et al.  Parametric Identification of Temporal Properties , 2011, RV.

[12]  Alberto L. Sangiovanni-Vincentelli,et al.  Model predictive control with signal temporal logic specifications , 2014, 53rd IEEE Conference on Decision and Control.

[13]  Calin Belta,et al.  Anomaly detection in cyber-physical systems: A formal methods approach , 2014, 53rd IEEE Conference on Decision and Control.

[14]  Calin Belta,et al.  Grid-based temporal logic inference , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[15]  Calin Belta,et al.  Online Learning of Temporal Logic Formulae for Signal Classification , 2018, 2018 European Control Conference (ECC).

[16]  Ufuk Topcu,et al.  Safe Reinforcement Learning via Shielding , 2017, AAAI.

[17]  Dana Angluin,et al.  Queries and concept learning , 1988, Machine Learning.

[18]  Yoshua Bengio,et al.  Pattern Recognition and Neural Networks , 1995 .

[19]  Daniel Neider,et al.  Learning Linear Temporal Properties , 2018, 2018 Formal Methods in Computer Aided Design (FMCAD).

[20]  Sanjit A. Seshia,et al.  Mining Requirements From Closed-Loop Control Models , 2015, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[21]  Hadas Kress-Gazit,et al.  Temporal Logic Motion Planning for Mobile Robots , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[22]  Ashish Tiwari,et al.  TeLEx: Passive STL Learning Using Only Positive Examples , 2017, RV.

[23]  Zhe Xu,et al.  Swarm Signal Temporal Logic Inference for Swarm Behavior Analysis , 2019, IEEE Robotics and Automation Letters.

[24]  Matthias Althoff,et al.  STL Model Checking of Continuous and Hybrid Systems , 2016, ATVA.

[25]  Calin Belta,et al.  Temporal logic inference for classification and prediction from data , 2014, HSCC.

[26]  Georgios E. Fainekos,et al.  On-Line Monitoring for Temporal Logic Robustness , 2014, RV.