Temporal logic inference for classification and prediction from data

This paper presents an inference algorithm that can discover temporal logic properties of a system from data. Our algorithm operates on finite time system trajectories that are labeled according to whether or not they demonstrate some desirable system properties (e.g. "the car successfully stops before hitting an obstruction"). A temporal logic formula that can discriminate between the desirable behaviors and the undesirable ones is constructed. The formulae also indicate possible causes for each set of behaviors (e.g. "If the speed of the car is greater than 15 m/s within 0.5s of brake application, the obstruction will be struck") which can be used to tune designs or to perform on-line monitoring to ensure the desired behavior. We introduce reactive parameter signal temporal logic (rPSTL), a fragment of parameter signal temporal logic (PSTL) that is expressive enough to capture causal, spatial, and temporal relationships in data. We define a partial order over the set of rPSTL formulae that is based on language inclusion. This order enables a directed search over this set, i.e. given a candidate rPSTL formula that does not adequately match the observed data, we can automatically construct a formula that will fit the data at least as well. Two case studies, one involving a cattle herding scenario and one involving a stochastic hybrid gene circuit model, are presented to illustrate our approach.

[1]  Andrew McCallum,et al.  Introduction to Statistical Relational Learning , 2007 .

[2]  Vítor Santos Costa,et al.  Inductive Logic Programming , 2013, Lecture Notes in Computer Science.

[3]  Christopher A. Voigt,et al.  Engineering bacterial signals and sensors. , 2009, Contributions to microbiology.

[4]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[5]  Lucie M. Gattepaille,et al.  Robustness Analysis and Behavior Discrimination in Enzymatic Reaction Networks , 2011, PloS one.

[6]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[7]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[8]  Georgios E. Fainekos,et al.  Querying Parametric Temporal Logic Properties on Embedded Systems , 2012, ICTSS.

[9]  Valentin Goranko,et al.  Logic in Computer Science: Modelling and Reasoning About Systems , 2007, J. Log. Lang. Inf..

[10]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[11]  Sanjit A. Seshia,et al.  Mining Requirements From Closed-Loop Control Models , 2015, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[12]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[13]  George J. Pappas,et al.  Robustness of temporal logic specifications for continuous-time signals , 2009, Theor. Comput. Sci..

[14]  Ezio Bartocci,et al.  On the Robustness of Temporal Properties for Stochastic Models , 2013, HSB.

[15]  Georgios E. Fainekos,et al.  Revising temporal logic specifications for motion planning , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Dejan Nickovic,et al.  Monitoring Temporal Properties of Continuous Signals , 2004, FORMATS/FTRTFT.

[17]  Oded Maler,et al.  Robust Satisfaction of Temporal Logic over Real-Valued Signals , 2010, FORMATS.

[18]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[19]  J. Kirby.  Designer bacteria degrades toxin. , 2010, Nature chemical biology.

[20]  Ben Taskar,et al.  Introduction to Statistical Relational Learning (Adaptive Computation and Machine Learning) , 2007 .

[21]  François Fages,et al.  On a Continuous Degree of Satisfaction of Temporal Logic Formulae with Applications to Systems Biology , 2008, CMSB.

[22]  Brian A. Davey,et al.  An Introduction to Lattices and Order , 1989 .

[23]  Calin Belta,et al.  Data-driven verification of synthetic gene networks , 2013, 52nd IEEE Conference on Decision and Control.

[24]  Dejan Nickovic,et al.  Parametric Identification of Temporal Properties , 2011, RV.