Multilevel Monte Carlo Method for Statistical Model Checking of Hybrid Systems

We study statistical model checking of continuous-time stochastic hybrid systems. The challenge in applying statistical model checking to these systems is that one cannot simulate such systems exactly. We employ the multilevel Monte Carlo method (MLMC) and work on a sequence of discrete-time stochastic processes whose executions approximate and converge weakly to that of the original continuous-time stochastic hybrid system with respect to satisfaction of the property of interest. With focus on bounded-horizon reachability, we recast the model checking problem as the computation of the distribution of the exit time, which is in turn formulated as the expectation of an indicator function. This latter computation involves estimating discontinuous functionals, which reduces the bound on the convergence rate of the Monte Carlo algorithm. We propose a smoothing step with tunable precision and formally quantify the error of the MLMC approach in the mean-square sense, which is composed of smoothing error, bias, and variance. We formulate a general adaptive algorithm which balances these error terms. Finally, we describe an application of our technique to verify a model of thermostatically controlled loads.

[1]  Martin Fränzle,et al.  Formal Synthesis and Validation of Inhomogeneous Thermostatically Controlled Loads , 2014, QEST.

[2]  Alessandro Abate,et al.  Approximately bisimilar symbolic models for randomly switched stochastic systems , 2014, Syst. Control. Lett..

[3]  Alessandro Abate,et al.  Aggregation and Control of Populations of Thermostatically Controlled Loads by Formal Abstractions , 2015, IEEE Transactions on Control Systems Technology.

[4]  J. Lygeros,et al.  General stochastic hybrid systems: modelling and optimal control , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[5]  Peter Arbenz,et al.  Determining optimal multilevel Monte Carlo parameters with application to fault tolerance , 2015, Comput. Math. Appl..

[6]  Edmund M. Clarke,et al.  Statistical Model Checking for Cyber-Physical Systems , 2011, ATVA.

[7]  Stefan Heinrich,et al.  Monte Carlo Complexity of Global Solution of Integral Equations , 1998, J. Complex..

[8]  Stefan Heinrich,et al.  Multilevel Monte Carlo Methods , 2001, LSSC.

[9]  S. Esmaeil Zadeh Soudjani,et al.  Formal Abstractions for Automated Verification and Synthesis of Stochastic Systems , 2014 .

[10]  Joost-Pieter Katoen,et al.  Quantitative automata-based controller synthesis for non-autonomous stochastic hybrid systems , 2013, HSCC '13.

[11]  Christel Baier,et al.  Model-Checking Algorithms for Continuous-Time Markov Chains , 2002, IEEE Trans. Software Eng..

[12]  Rupak Majumdar,et al.  Safety Verification of Continuous-Space Pure Jump Markov Processes , 2016, TACAS.

[13]  Michael B. Giles,et al.  Multilevel Monte Carlo Path Simulation , 2008, Oper. Res..

[14]  Alessandro Abate,et al.  Adaptive and Sequential Gridding Procedures for the Abstraction and Verification of Stochastic Processes , 2013, SIAM J. Appl. Dyn. Syst..

[15]  Thomas A. Henzinger,et al.  Faster Statistical Model Checking for Unbounded Temporal Properties , 2016, TACAS.

[16]  C. Cassandras,et al.  Stochastic hybrid systems , 2006 .

[17]  Kim G. Larsen,et al.  Statistical Model Checking: Past, Present, and Future , 2016, ISoLA.

[18]  M. Giles,et al.  Multilevel Path Simulation for Jump-Diffusion SDEs , 2012 .

[19]  Luca Cardelli,et al.  Reachability Computation for Switching Diffusions: Finite Abstractions with Certifiable and Tuneable Precision , 2017, HSCC.

[20]  Duncan S. Callaway,et al.  State Estimation and Control of Electric Loads to Manage Real-Time Energy Imbalance , 2013, IEEE Transactions on Power Systems.

[21]  John Lygeros,et al.  Reachability Questions in Piecewise Deterministic Markov Processes , 2003, HSCC.

[22]  John Lygeros,et al.  Symbolic Control of Stochastic Systems via Approximately Bisimilar Finite Abstractions , 2013, IEEE Transactions on Automatic Control.

[23]  Klaus Ritter,et al.  Multilevel Monte Carlo Approximation of Distribution Functions and Densities , 2015, SIAM/ASA J. Uncertain. Quantification.

[24]  Martin Fränzle,et al.  Stochastic Satisfiability Modulo Theory: A Novel Technique for the Analysis of Probabilistic Hybrid Systems , 2008, HSCC.

[25]  Axel Legay,et al.  Statistical Model Checking: An Overview , 2010, RV.

[26]  Jan Kretínský,et al.  Survey of Statistical Verification of Linear Unbounded Properties: Model Checking and Distances , 2016, ISoLA.

[27]  Christel Baier,et al.  Principles of model checking , 2008 .

[28]  Kim G. Larsen,et al.  Checking and Distributing Statistical Model Checking , 2012, NASA Formal Methods.

[29]  Mahesh Viswanathan,et al.  Statistical verification of dynamical systems using set oriented methods , 2015, HSCC.

[30]  John Lygeros,et al.  Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems , 2008, Autom..

[31]  John Lygeros,et al.  Modeling options for demand side participation of thermostatically controlled loads , 2013, 2013 IREP Symposium Bulk Power System Dynamics and Control - IX Optimization, Security and Control of the Emerging Power Grid.

[32]  John Lygeros,et al.  Stochastic Hybrid Models: An Overview , 2003, ADHS.

[33]  George J. Pappas,et al.  A Framework for Worst-Case and Stochastic Safety Verification Using Barrier Certificates , 2007, IEEE Transactions on Automatic Control.

[34]  Klaus Ritter,et al.  Adaptive Multilevel Monte Carlo Approximation of Distribution Functions , 2017, 1706.06869.