Time-Incremental Learning from Data Using Temporal Logics

Real-time and human-interpretable decision-making in cyber-physical systems is a significant but challenging task, which usually requires predictions of possible future events from limited data. In this paper, we introduce a time-incremental learning framework: given a dataset of labeled signal traces with a common time horizon, we propose a method to predict the label of a signal that is received incrementally over time, referred to as prefix signal. Prefix signals are the signals that are being observed as they are generated, and their time length is shorter than the common horizon of signals. We present a novel decision-tree based approach to generate a finite number of Signal Temporal Logic (STL) specifications from the given dataset, and construct a predictor based on them. Each STL specification, as a binary classifier of time-series data, captures the temporal properties of the dataset over time. The predictor is constructed by assigning time-variant weights to the STL formulas. The weights are learned by using neural networks, with the goal of minimizing the misclassification rate for the prefix signals defined over the given dataset. The learned predictor is used to predict the label of a prefix signal, by computing the weighted sum of the robustness of the prefix signal with respect to each STL formula. The effectiveness and classification performance of our algorithm are evaluated on an urban-driving and a naval-surveillance case studies.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[3]  Oded Maler,et al.  Robust Satisfaction of Temporal Logic over Real-Valued Signals , 2010, FORMATS.

[4]  Sanjit A. Seshia,et al.  Logical Clustering and Learning for Time-Series Data , 2016, 1612.07823.

[5]  Daniel Neider,et al.  Learning Linear Temporal Properties , 2018, 2018 Formal Methods in Computer Aided Design (FMCAD).

[6]  Sanjit A. Seshia,et al.  Mining Requirements From Closed-Loop Control Models , 2015, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[7]  Marco Cuturi,et al.  Soft-DTW: a Differentiable Loss Function for Time-Series , 2017, ICML.

[8]  Alexis Linard,et al.  Active Learning of Signal Temporal Logic Specifications , 2020, 2020 IEEE 16th International Conference on Automation Science and Engineering (CASE).

[9]  Zhe Xu,et al.  Swarm Signal Temporal Logic Inference for Swarm Behavior Analysis , 2019, IEEE Robotics and Automation Letters.

[10]  Jyotirmoy V. Deshmukh,et al.  Mining Environment Assumptions for Cyber-Physical System Models , 2020, 2020 ACM/IEEE 11th International Conference on Cyber-Physical Systems (ICCPS).

[11]  Ashish Tiwari,et al.  TeLEx: learning signal temporal logic from positive examples using tightness metric , 2019, Formal Methods Syst. Des..

[12]  Georgios E. Fainekos,et al.  Mining parametric temporal logic properties in model-based design for cyber-physical systems , 2015, International Journal on Software Tools for Technology Transfer.

[13]  Ufuk Topcu,et al.  Uncertainty-Aware Signal Temporal logic , 2021, ArXiv.

[14]  Ufuk Topcu,et al.  Information-Guided Temporal Logic Inference with Prior Knowledge , 2019, 2019 American Control Conference (ACC).

[15]  Dejan Nickovic,et al.  Monitoring Temporal Properties of Continuous Signals , 2004, FORMATS/FTRTFT.

[16]  Calin Belta,et al.  Specifying User Preferences using Weighted Signal Temporal Logic , 2020, 2021 American Control Conference (ACC).

[17]  Calin Belta,et al.  Temporal Logics for Learning and Detection of Anomalous Behavior , 2017, IEEE Transactions on Automatic Control.

[18]  Yoshua Bengio,et al.  Pattern Recognition and Neural Networks , 1995 .

[19]  Calin Belta,et al.  A Decision Tree Approach to Data Classification using Signal Temporal Logic , 2016, HSCC.

[20]  Ebru Aydin Gol,et al.  Synthesis of Monitoring Rules via Data Mining , 2019, 2019 American Control Conference (ACC).

[21]  Calin Belta,et al.  Classification of Time-Series Data Using Boosted Decision Trees , 2021, ArXiv.

[22]  Calin Belta,et al.  Signal Clustering Using Temporal Logics , 2017, RV.

[23]  Ezio Bartocci,et al.  System design of stochastic models using robustness of temporal properties , 2015, Theor. Comput. Sci..

[24]  Dejan Nickovic,et al.  Parametric Identification of Temporal Properties , 2011, RV.

[25]  Ezio Bartocci,et al.  Data-Driven Statistical Learning of Temporal Logic Properties , 2014, FORMATS.

[26]  Jyotirmoy V. Deshmukh,et al.  Interpretable classification of time-series data using efficient enumerative techniques , 2019, HSCC.

[27]  Leto Peel,et al.  Maritime anomaly detection using Gaussian Process active learning , 2012, 2012 15th International Conference on Information Fusion.

[28]  Thomas Ferrère,et al.  Efficient Parametric Identification for STL , 2018, HSCC.

[29]  Ruixuan Yan,et al.  Neural Network for Weighted Signal Temporal Logic , 2021, ArXiv.

[30]  George J. Pappas,et al.  Robustness of temporal logic specifications for continuous-time signals , 2009, Theor. Comput. Sci..