Enhancing Temporal Logic Falsification With Specification Transformation and Valued Booleans

Cyber-physical systems (CPSs) are systems with both physical and software components, for example, cars and industrial robots. Since these systems exhibit both discrete and continuous dynamics, they are complex and it is thus difficult to verify that they behave as expected. Falsification of temporal logic properties is an approach to find counterexamples to CPSs by means of simulation. In this article, we propose two additions to enhance the capability of falsification and make it more viable in a large-scale industrial setting. The first addition is a framework for transforming specifications from a signal-based model into signal temporal logic. The second addition is the use of valued Booleans and an additive robust semantics in the falsification process. We evaluate the performance of the additive robust semantics on a set of benchmark models, and we can see that which semantics are preferable depend both on the model and on the specification.

[1]  Ron Koymans,et al.  Specifying real-time properties with metric temporal logic , 1990, Real-Time Systems.

[2]  Timothy Bourke,et al.  Non-standard semantics of hybrid systems modelers , 2012, J. Comput. Syst. Sci..

[3]  Georgios E. Fainekos,et al.  Vacuity aware falsification for MTL request-response specifications , 2017, 2017 13th IEEE Conference on Automation Science and Engineering (CASE).

[4]  Knut Åkesson,et al.  Using Valued Booleans to Find Simpler Counterexamples in Random Testing of Cyber-Physical Systems , 2018 .

[5]  Dejan Nickovic,et al.  Specification-Based Monitoring of Cyber-Physical Systems: A Survey on Theory, Tools and Applications , 2018, Lectures on Runtime Verification.

[6]  Dejan Nickovic,et al.  Monitoring Temporal Properties of Continuous Signals , 2004, FORMATS/FTRTFT.

[7]  Joseph Sifakis,et al.  Model checking , 1996, Handbook of Automated Reasoning.

[8]  Ichiro Hasuo,et al.  Time Robustness in MTL and Expressivity in Hybrid System Falsification , 2015, CAV.

[9]  George J. Pappas,et al.  Robust Sampling for MITL Specifications , 2007, FORMATS.

[10]  Georgios E. Fainekos,et al.  VISPEC: A graphical tool for elicitation of MTL requirements , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Knut Åkesson,et al.  Objective functions for falsification of signal temporal logic properties in cyber-physical systems , 2017, 2017 13th IEEE Conference on Automation Science and Engineering (CASE).

[12]  George J. Pappas,et al.  Robustness of temporal logic specifications for continuous-time signals , 2009, Theor. Comput. Sci..

[13]  Sriram Sankaranarayanan,et al.  Requirements driven falsification with coverage metrics , 2015, 2015 International Conference on Embedded Software (EMSOFT).

[14]  Nikolaos Kekatos,et al.  Formal Verification of Cyber-Physical Systems in the Industrial Model-Based Design Process. (Vérification formelle des systèmes cyber-physiques dans le processus industriel de la conception basée sur modèle) , 2018 .

[15]  Stavros Tripakis,et al.  The Refinement Calculus of Reactive Systems Toolset , 2017, International Journal on Software Tools for Technology Transfer.

[16]  Sanjit A. Seshia,et al.  Mining Requirements From Closed-Loop Control Models , 2015, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[17]  Pravin Varaiya,et al.  What's decidable about hybrid automata? , 1995, STOC '95.

[18]  Houssam Abbas,et al.  Functional gradient descent method for Metric Temporal Logic specifications , 2014, 2014 American Control Conference.

[19]  Kenneth R. Butts,et al.  Powertrain control verification benchmark , 2014, HSCC.

[20]  Georgios E. Fainekos,et al.  Formal Requirement Debugging for Testing and Verification of Cyber-Physical Systems , 2016, ACM Trans. Embed. Comput. Syst..

[21]  Yashwanth Singh Rahul Annapureddy,et al.  Ant colonies for Temporal Logic falsification of hybrid systems , 2010, IECON 2010 - 36th Annual Conference on IEEE Industrial Electronics Society.

[22]  Sriram Sankaranarayanan,et al.  Verification of automotive control applications using S-TaLiRo , 2012, 2012 American Control Conference (ACC).

[23]  Dejan Nickovic,et al.  Temporal Logic as Filtering , 2016, HSCC.

[24]  Sriram Sankaranarayanan,et al.  S-TaLiRo: A Tool for Temporal Logic Falsification for Hybrid Systems , 2011, TACAS.

[25]  Georgios E. Fainekos,et al.  Metric interval temporal logic specification elicitation and debugging , 2015, 2015 ACM/IEEE International Conference on Formal Methods and Models for Codesign (MEMOCODE).

[26]  Lawrence Charles Paulson,et al.  Isabelle/HOL: A Proof Assistant for Higher-Order Logic , 2002 .

[27]  Marco Di Natale,et al.  Generation of simulink monitors for control applications from formal requirements , 2017, 2017 12th IEEE International Symposium on Industrial Embedded Systems (SIES).

[28]  Mohammad Reza Mousavi,et al.  Temporal Logic Falsification of Cyber-Physical Systems: An Input-Signal-Space Optimization Approach , 2018, 2018 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW).

[29]  Shiyan Hu,et al.  Design Automation of Cyber-Physical Systems: Challenges, Advances, and Opportunities , 2017, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[30]  Oded Maler,et al.  Verification of Analog and Mixed-Signal Circuits Using Hybrid System Techniques , 2004, FMCAD.

[31]  Houssam Abbas,et al.  Benchmarks for Temporal Logic Requirements for Automotive Systems , 2014, ARCH@CPSWeek.

[32]  Alexandre Donzé,et al.  Breach, A Toolbox for Verification and Parameter Synthesis of Hybrid Systems , 2010, CAV.

[33]  Sriram Sankaranarayanan,et al.  Probabilistic Temporal Logic Falsification of Cyber-Physical Systems , 2013, TECS.

[34]  Lubos Brim,et al.  STL⁎: Extending signal temporal logic with signal-value freezing operator , 2014, Inf. Comput..

[35]  Ezio Bartocci,et al.  An Algebraic Framework for Runtime Verification , 2018, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[36]  André Platzer,et al.  Logical Foundations of Cyber-Physical Systems , 2018, Springer International Publishing.

[37]  Oded Maler,et al.  Robust Satisfaction of Temporal Logic over Real-Valued Signals , 2010, FORMATS.

[38]  Ken Butts,et al.  Simulation-Based Approaches for Verification of Embedded Control Systems: An Overview of Traditional and Advanced Modeling, Testing, and Verification Techniques , 2016, IEEE Control Systems.

[39]  Sanjit A. Seshia,et al.  ST-Lib: A Library for Specifying and Classifying Model Behaviors , 2016, SAE Technical Paper Series.

[40]  Takumi Akazaki.  Falsification of Conditional Safety Properties for Cyber-Physical Systems with Gaussian Process Regression , 2016, RV.

[41]  Sanjit A. Seshia,et al.  Reactive synthesis from signal temporal logic specifications , 2015, HSCC.