Robustness-guided temporal logic testing and verification for Stochastic Cyber-Physical Systems

We present a framework for automatic specification-guided testing for Stochastic Cyber-Physical Systems (SCPS). The framework utilizes the theory of robustness of Metric Temporal Logic (MTL) specifications to quantify how robustly an SCPS satisfies a specification in MTL. The goal of the testing framework is to detect system operating conditions that cause the system to exhibit the worst expected specification robustness. The resulting expected robustness minimization problem is solved using Markov chain Monte Carlo algorithms. This also allows us to use finite-time guarantees, which quantify the quality of the solution after a finite number of simulations. In a Model-Based Design (MBD) process, our framework can be combined with Statistical Model Checking (SMC). Finally, we present a case study on a high fidelity engine model where the goal is to verify the air-to-fuel ratio problem.

[1]  J. Bernardo,et al.  Simulation-Based Optimal Design , 1999 .

[2]  Decidable Model Checking of Probabilistic Hybrid Automata , 2000, FTRTFT.

[3]  Anna Philippou,et al.  Tools and Algorithms for the Construction and Analysis of Systems , 2018, Lecture Notes in Computer Science.

[4]  Håkan L. S. Younes,et al.  Probabilistic Verification of Discrete Event Systems Using Acceptance Sampling , 2002, CAV.

[5]  Qianchuan Zhao,et al.  Generating test inputs for embedded control systems , 2003 .

[6]  Wolfgang Müller,et al.  Model-based design of embedded systems , 2004, Seventh IEEE International Symposium onObject-Oriented Real-Time Distributed Computing, 2004. Proceedings..

[7]  Radu Grosu,et al.  Monte Carlo Model Checking , 2005, TACAS.

[8]  A.L. Sangiovanni-Vincentelli,et al.  Hybrid Systems in Automotive Electronics Design , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[9]  Ron Koymans,et al.  Specifying real-time properties with metric temporal logic , 1990, Real-Time Systems.

[10]  Andrew Hinton,et al.  PRISM: A Tool for Automatic Verification of Probabilistic Systems , 2006, TACAS.

[11]  George J. Pappas,et al.  Robustness of Temporal Logic Specifications , 2006, FATES/RV.

[12]  Sriram Sankaranarayanan,et al.  State space exploration using feedback constraint generation and Monte-Carlo sampling , 2007, ESEC-FSE '07.

[13]  George J. Pappas,et al.  Robustness of temporal logic specifications for continuous-time signals , 2009, Theor. Comput. Sci..

[14]  Stavros Tripakis,et al.  Modeling, Verification and Testing using Timed and Hybrid Automata , 2009 .

[15]  Alexandre Donzé,et al.  Breach, A Toolbox for Verification and Parameter Synthesis of Hybrid Systems , 2010, CAV.

[16]  Edmund M. Clarke,et al.  Bayesian statistical model checking with application to Stateflow/Simulink verification , 2010, Formal Methods in System Design.

[17]  John Lygeros,et al.  Stochastic Optimization on Continuous Domains With Finite-Time Guarantees by Markov Chain Monte Carlo Methods , 2009, IEEE Transactions on Automatic Control.

[18]  François Fages,et al.  Continuous valuations of temporal logic specifications with applications to parameter optimization and robustness measures , 2011, Theor. Comput. Sci..

[19]  Joost-Pieter Katoen,et al.  Quantitative automata model checking of autonomous stochastic hybrid systems , 2011, HSCC '11.

[20]  Sriram Sankaranarayanan,et al.  S-TaLiRo: A Tool for Temporal Logic Falsification for Hybrid Systems , 2011, TACAS.

[21]  Sriram Sankaranarayanan,et al.  Verification of automotive control applications using S-TaLiRo , 2012, 2012 American Control Conference (ACC).

[22]  S. Kakade,et al.  Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting , 2012, IEEE Transactions on Information Theory.

[23]  Georgios E. Fainekos,et al.  Querying Parametric Temporal Logic Properties on Embedded Systems , 2012, ICTSS.

[24]  Kim G. Larsen,et al.  Statistical Model Checking for Stochastic Hybrid Systems , 2012, HSB.

[25]  Jianghai Hu,et al.  Stochastic Hybrid Systems , 2013 .

[26]  Ezio Bartocci,et al.  On the Robustness of Temporal Properties for Stochastic Models , 2013, HSB.

[27]  Sriram Sankaranarayanan,et al.  Probabilistic Temporal Logic Falsification of Cyber-Physical Systems , 2013, TECS.