Learning Properties in LTL ∩ ACTL from Positive Examples Only

Inferring correct and meaningful specifications of complex (black-box) systems is an important problem in practice, which arises naturally in debugging, reverse engineering, formal verification, and explainable AI, to name just a few examples. Usually, one here assumes that both positive and negative examples of system traces are given-an assumption that is often unrealistic in practice because negative examples (i.e., examples that the system cannot exhibit) are typically hard to obtain. To overcome this serious practical limitation, we develop a novel technique that is able to infer specifications in the form of universal very-weak automata from positive examples only. This type of automata captures exactly the class of properties in the intersection of Linear Temporal Logic (LTL) and the universal fragment of Computation Tree Logic (ACTL), and features an easy-to-interpret graphical representation. Our proposed algorithm reduces the problem of learning a universal very-weak automaton to the enumeration of elements in the Pareto front of a specifically-designed monotonous function and uses classical automaton minimization to obtain a concise, finite-state representation of the learned property. In a case study with specifications from the Advanced Microcontroller Bus Architecture, we demonstrate that our approach is able to infer meaningful, concise, and easy-to-interpret specifications from positive examples only.

[1]  Sanjit A. Seshia,et al.  Learning Task Specifications from Demonstrations , 2017, NeurIPS.

[2]  J. Oncina,et al.  INFERRING REGULAR LANGUAGES IN POLYNOMIAL UPDATED TIME , 1992 .

[3]  Umesh V. Vazirani,et al.  An Introduction to Computational Learning Theory , 1994 .

[4]  Alberto Camacho,et al.  Learning Interpretable Models Expressed in Linear Temporal Logic , 2019, ICAPS.

[5]  Calin Belta,et al.  A Decision Tree Approach to Data Classification using Signal Temporal Logic , 2016, HSCC.

[6]  Rüdiger Ehlers,et al.  A Fragment of Linear Temporal Logic for Universal Very Weak Automata , 2018, ATVA.

[7]  Krishnendu Chatterjee,et al.  Synthesis of AMBA AHB from formal specification: a case study , 2011, International Journal on Software Tools for Technology Transfer.

[8]  Daniel Neider,et al.  Learning Linear Temporal Properties , 2018, 2018 Formal Methods in Computer Aided Design (FMCAD).

[9]  David Harel,et al.  LSCs: Breathing Life into Message Sequence Charts , 1999, Formal Methods Syst. Des..

[10]  Rüdiger Ehlers,et al.  Computing the Complete Pareto Front , 2015, ArXiv.

[11]  Marijn J. H. Heule,et al.  Exact DFA Identification Using SAT Solvers , 2010, ICGI.

[13]  Andrew Y. Ng,et al.  Pharmacokinetics of a novel formulation of ivermectin after administration to goats , 2000, ICML.

[14]  Josep Carmona,et al.  A Tour in Process Mining: From Practice to Algorithmic Challenges , 2019, Trans. Petri Nets Other Model. Concurr..

[15]  David Lo,et al.  Mining Scenario-Based Triggers and Effects , 2008, 2008 23rd IEEE/ACM International Conference on Automated Software Engineering.

[16]  Alexandre Petrenko,et al.  Inferring DFA without Negative Examples , 2018, ICGI.

[17]  Jyotirmoy V. Deshmukh,et al.  Interpretable classification of time-series data using efficient enumerative techniques , 2019, HSCC.

[18]  Amir Pnueli,et al.  Temporal Logic for Scenario-Based Specifications , 2005, TACAS.

[19]  Bengt Jonsson,et al.  Systematic Acceleration in Regular Model Checking , 2007, CAV.

[20]  Fred Kröger,et al.  Temporal Logic of Programs , 1987, EATCS Monographs on Theoretical Computer Science.

[21]  Nils Jansen,et al.  Regular Model Checking Using Solver Technologies and Automata Learning , 2013, NASA Formal Methods.

[22]  David Lo,et al.  Specification mining of symbolic scenario-based models , 2008, PASTE '08.

[23]  Dana Angluin,et al.  Learning Regular Sets from Queries and Counterexamples , 1987, Inf. Comput..

[24]  Orna Kupferman,et al.  Safraless decision procedures , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[25]  Bernd Westphal,et al.  On the Expressive Power of Live Sequence Charts , 2006, Program Analysis and Compilation.

[26]  Ronald L. Rivest,et al.  Inference of finite automata using homing sequences , 1989, STOC '89.

[27]  Rüdiger Ehlers,et al.  Minimising Deterministic Büchi Automata Precisely Using SAT Solving , 2010, SAT.

[28]  Christian Muise,et al.  Bayesian Inference of Linear Temporal Logic Specifications for Contrastive Explanations , 2019, IJCAI.

[29]  Rüdiger Ehlers,et al.  ACTL ∩ LTL Synthesis , 2012, CAV.

[30]  Monika Maidl,et al.  The Common Fragment of CTL and LTL , 2000, FOCS.

[31]  Mikolaj Bojanczyk The Common Fragment of ACTL and LTL , 2008, FoSSaCS.

[32]  Jian Pei,et al.  Data Mining: Concepts and Techniques, 3rd edition , 2006 .