Importance Sampling of Interval Markov Chains

In real-world systems, rare events often characterize critical situations like the probability that a system fails within some time bound and they are used to model some potentially harmful scenarios in dependability of safety-critical systems. Probabilistic Model Checking has been used to verify dependability properties in various types of systems but is limited by the state space explosion problem. An alternative is the recourse to Statistical Model Checking (SMC) that relies on Monte Carlo simulations and provides estimates within predefined error and confidence bounds. However, rare properties require a large number of simulations before occurring at least once. To tackle the problem, Importance Sampling, a rare event simulation technique, has been proposed in SMC for different types of probabilistic systems. Importance Sampling requires the full knowledge of probabilistic measure of the system, e.g. Markov chains. In practice, however, we often have models with some uncertainty, e.g., Interval Markov Chains. In this work, we propose a method to apply importance sampling to Interval Markov Chains. We show promising results in applying our method to multiple case studies.

[1]  Lijun Zhang,et al.  Logic and Model Checking for Hidden Markov Models , 2005, FORTE.

[2]  Håkan L. S. Younes,et al.  Verification and planning for stochastic processes with asynchronous events , 2004 .

[3]  Edmund M. Clarke,et al.  Statistical Model Checking for Cyber-Physical Systems , 2011, ATVA.

[4]  Moshe Y. Vardi Automatic verification of probabilistic concurrent finite state programs , 1985, 26th Annual Symposium on Foundations of Computer Science (sfcs 1985).

[5]  Serge Haddad,et al.  Coupling and Importance Sampling for Statistical Model Checking , 2012, TACAS.

[6]  Benoît Delahaye,et al.  Reachability in Parametric Interval Markov Chains Using Constraints , 2017, QEST.

[7]  Ad Ridder,et al.  Importance Sampling Simulations of Markovian Reliability Systems Using Cross-Entropy , 2005, Ann. Oper. Res..

[8]  M. Kwiatkowska,et al.  PRISM 2.0: a tool for probabilistic model checking , 2004, First International Conference on the Quantitative Evaluation of Systems, 2004. QEST 2004. Proceedings..

[9]  Mark W. Schmidt,et al.  An interior-point stochastic approximation method and an L1-regularized delta rule , 2008, NIPS.

[10]  William A. Gale,et al.  Good-Turing Frequency Estimation Without Tears , 1995, J. Quant. Linguistics.

[11]  Cyrille Jégourel,et al.  Command-based importance sampling for statistical model checking , 2016, Theor. Comput. Sci..

[12]  Mihalis Yannakakis,et al.  Verifying temporal properties of finite-state probabilistic programs , 1988, [Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science.

[13]  Boudewijn R. Haverkort,et al.  Rare Event Simulation for Highly Dependable Systems with Fast Repairs , 2010, QEST.

[14]  Thomas Hérault,et al.  Approximate Probabilistic Model Checking , 2004, VMCAI.

[15]  H. Chernoff A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations , 1952 .

[16]  James C. Spall,et al.  Introduction to stochastic search and optimization - estimation, simulation, and control , 2003, Wiley-Interscience series in discrete mathematics and optimization.

[17]  A. Nemirovski,et al.  Interior-point methods for optimization , 2008, Acta Numerica.

[18]  Gerardo Rubino,et al.  Rare Event Simulation using Monte Carlo Methods , 2009 .

[19]  F. Downton Stochastic Approximation , 1969, Nature.

[20]  Kim Guldstrand Larsen,et al.  Specification and refinement of probabilistic processes , 1991, [1991] Proceedings Sixth Annual IEEE Symposium on Logic in Computer Science.

[21]  Cyrille Jégourel,et al.  Importance Splitting for Statistical Model Checking Rare Properties , 2013, CAV.

[22]  Axel Legay,et al.  A Bayesian Approach to Model Checking Biological Systems , 2009, CMSB.

[23]  Sandeep K. Shukla,et al.  Evaluating the reliability of NAND multiplexing with PRISM , 2005, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[24]  Kim G. Larsen,et al.  Consistency and refinement for Interval Markov Chains , 2012, J. Log. Algebraic Methods Program..

[25]  M. Okamoto Some inequalities relating to the partial sum of binomial probabilities , 1959 .

[26]  W. G. Cochran Laplace's Ratio Estimator , 1978 .

[27]  R. Khan,et al.  Sequential Tests of Statistical Hypotheses. , 1972 .