Robustness of Specifications and Its Applications to Falsification, Parameter Mining, and Runtime Monitoring with S-TaLiRo

Logical specifications have enabled formal methods by carefully describing what is correct, desired or expected of a given system. They have been widely used in runtime monitoring and applied to domains ranging from medical devices to information security. In this tutorial, we will present the theory and application of robustness of logical specifications. Rather than evaluate logical formulas to Boolean valuations, robustness interpretations attempt to provide numerical valuations that provide degrees of satisfaction, in addition to true/false valuations to models. Such a valuation can help us distinguish between behaviors that “barely” satisfy a specification to those that satisfy it in a robust manner. We will present and compare various notions of robustness in this tutorial, centered primarily around applications to safety-critical Cyber-Physical Systems (CPS). We will also present key ways in which the robustness notions can be applied to problems such as runtime monitoring, falsification search for finding counterexamples, and mining design parameters for synthesis.

[1]  Georgios E. Fainekos,et al.  Formal Requirement Debugging for Testing and Verification of Cyber-Physical Systems , 2016, ACM Trans. Embed. Comput. Syst..

[2]  Gidon Ernst,et al.  Two-Layered Falsification of Hybrid Systems Guided by Monte Carlo Tree Search , 2018, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[3]  Georgios E. Fainekos,et al.  Mining parametric temporal logic properties in model-based design for cyber-physical systems , 2015, International Journal on Software Tools for Technology Transfer.

[4]  Georgios E. Fainekos,et al.  On-Line Monitoring for Temporal Logic Robustness , 2014, RV.

[5]  Florian Leitner-Fischer,et al.  Simulink Design Verifier vs. SPIN : a comparative case study , 2008 .

[6]  Georgios Fainekos,et al.  Gray-box adversarial testing for control systems with machine learning components , 2018, HSCC.

[7]  Sriram Sankaranarayanan,et al.  Probabilistic Temporal Logic Falsification of Cyber-Physical Systems , 2013, TECS.

[8]  Dejan Nickovic,et al.  Monitoring Temporal Properties of Continuous Signals , 2004, FORMATS/FTRTFT.

[9]  Houssam Abbas,et al.  Robustness-guided temporal logic testing and verification for Stochastic Cyber-Physical Systems , 2014, The 4th Annual IEEE International Conference on Cyber Technology in Automation, Control and Intelligent.

[10]  Georgios E. Fainekos,et al.  VISPEC: A graphical tool for elicitation of MTL requirements , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Georgios Fainekos,et al.  Worst-case Satisfaction of STL Specifications Using Feedforward Neural Network Controllers , 2019, ACM Trans. Embed. Comput. Syst..

[12]  Ken Butts,et al.  Simulation-Based Approaches for Verification of Embedded Control Systems: An Overview of Traditional and Advanced Modeling, Testing, and Verification Techniques , 2016, IEEE Control Systems.

[13]  Gidon Ernst,et al.  ARCH-COMP18 Category Report: Results on the Falsification Benchmarks , 2018, ARCH@ADHS.

[14]  Houssam Abbas,et al.  Formal property verification in a conformance testing framework , 2014, 2014 Twelfth ACM/IEEE Conference on Formal Methods and Models for Codesign (MEMOCODE).

[15]  Dejan Nickovic,et al.  Specification-Based Monitoring of Cyber-Physical Systems: A Survey on Theory, Tools and Applications , 2018, Lectures on Runtime Verification.

[16]  Houssam Abbas,et al.  Benchmarks for Temporal Logic Requirements for Automotive Systems , 2014, ARCH@CPSWeek.

[17]  Sriram Sankaranarayanan,et al.  Verification of automotive control applications using S-TaLiRo , 2012, 2012 American Control Conference (ACC).

[18]  Houssam Abbas,et al.  Safe At Any Speed: A Simulation-Based Test Harness for Autonomous Vehicles , 2017, CyPhy.

[19]  Sriram Sankaranarayanan,et al.  Experience Report: Application of Falsification Methods on the UxAS System , 2018, NFM.

[20]  Sriram Sankaranarayanan,et al.  Analyzing Neighborhoods of Falsifying Traces in Cyber-Physical Systems , 2017, 2017 ACM/IEEE 8th International Conference on Cyber-Physical Systems (ICCPS).

[21]  Ron Koymans,et al.  Specifying real-time properties with metric temporal logic , 1990, Real-Time Systems.

[22]  Georgios Fainekos,et al.  Falsification of Cyber-Physical Systems with Robustness Uncertainty Quantification Through Stochastic optimization with Adaptive Restart , 2019, 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE).

[23]  Sriram Sankaranarayanan,et al.  Requirements driven falsification with coverage metrics , 2015, 2015 International Conference on Embedded Software (EMSOFT).

[24]  Sriram Sankaranarayanan,et al.  Towards a Verified Artificial Pancreas: Challenges and Solutions for Runtime Verification , 2015, RV.

[25]  Alberto L. Sangiovanni-Vincentelli,et al.  Systematic Testing of Convolutional Neural Networks for Autonomous Driving , 2017, ArXiv.

[26]  Sriram Sankaranarayanan,et al.  Formal Techniques for Verification and Testing of Cyber-Physical Systems , 2019, Design Automation of Cyber-Physical Systems.

[27]  Dejan Nickovic,et al.  Parametric Identification of Temporal Properties , 2011, RV.

[28]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[29]  Gidon Ernst,et al.  ARCH-COMP 2019 Category Report: Falsification , 2019, ARCH@CPSIoTWeek.

[30]  Oded Maler,et al.  Robust Satisfaction of Temporal Logic over Real-Valued Signals , 2010, FORMATS.

[31]  Mohamed Khalgui,et al.  Introduction to the Special Issue on Modeling and Verification of Discrete Event Systems , 2013, TECS.

[32]  Laura Moy,et al.  Killed by Code: Software Transparency in Implantable Medical Devices , 2010 .

[33]  Dejan Nickovic,et al.  Interface-aware signal temporal logic , 2019, HSCC.

[34]  Sriram Sankaranarayanan,et al.  Monte-carlo techniques for falsification of temporal properties of non-linear hybrid systems , 2010, HSCC '10.

[35]  George J. Pappas,et al.  Robustness of temporal logic specifications for continuous-time signals , 2009, Theor. Comput. Sci..

[36]  Georgios Fainekos,et al.  Simulation-based Adversarial Test Generation for Autonomous Vehicles with Machine Learning Components , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[37]  George J. Pappas,et al.  Robustness of Temporal Logic Specifications , 2006, FATES/RV.

[38]  Alexandre Donzé,et al.  Breach, A Toolbox for Verification and Parameter Synthesis of Hybrid Systems , 2010, CAV.

[39]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[40]  Alberto L. Sangiovanni-Vincentelli,et al.  Scenic: a language for scenario specification and scene generation , 2018, PLDI.

[41]  Jianye Hao,et al.  Falsification of Cyber-Physical Systems Using Deep Reinforcement Learning , 2018, IEEE Transactions on Software Engineering.

[42]  Sebastian Fischmeister,et al.  A Survey of Electrical and Electronic (E/E) Notifications for Motor Vehicles , 2015 .

[43]  Sriram Sankaranarayanan,et al.  S-TaLiRo: A Tool for Temporal Logic Falsification for Hybrid Systems , 2011, TACAS.

[44]  Georgios Fainekos,et al.  Evaluating Perception Systems for Autonomous Vehicles Using Quality Temporal Logic , 2018, RV.

[45]  Sriram Sankaranarayanan,et al.  Trajectory Tracking Control for Robotic Vehicles Using Counterexample Guided Training of Neural Networks , 2019, ICAPS.