Asymptotic Perturbation Bounds for Probabilistic Model Checking with Empirically Determined Probability Parameters

Probabilistic model checking is a verification technique that has been the focus of intensive research for over a decade. One important issue with probabilistic model checking, which is crucial for its practical significance but is overlooked by the state-of-the-art largely, is the potential discrepancy between a stochastic model and the real-world system it represents when the model is built from statistical data. In the worst case, a tiny but nontrivial change to some model quantities might lead to misleading or even invalid verification results. To address this issue, in this paper, we present a mathematical characterization of the consequences of model perturbations on the verification distance. The formal model that we adopt is a parametric variant of discrete-time Markov chains equipped with a vector norm to measure the perturbation. Our main technical contributions include a closed-form formulation of asymptotic perturbation bounds, and computational methods for two arguably most useful forms of those bounds, namely linear bounds and quadratic bounds. We focus on verification of reachability properties but also address automata-based verification of omega-regular properties. We present the results of a selection of case studies that demonstrate that asymptotic perturbation bounds can accurately estimate maximum variations of verification results induced by model perturbations.

[1]  Rajeev Alur,et al.  Perturbed Timed Automata , 2005, HSCC.

[2]  Moshe Y. Vardi Automatic verification of probabilistic concurrent finite state programs , 1985, 26th Annual Symposium on Foundations of Computer Science (sfcs 1985).

[3]  Carlo Ghezzi,et al.  Run-time efficient probabilistic model checking , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[4]  M. Puterman Chapter 8 Markov decision processes , 1990 .

[5]  Piet Van Mieghem,et al.  Performance analysis of communications networks and systems , 2006 .

[6]  Carlo Ghezzi,et al.  Supporting Self-Adaptation via Quantitative Verification and Sensitivity Analysis at Run Time , 2016, IEEE Transactions on Software Engineering.

[7]  Anna Philippou,et al.  Tools and Algorithms for the Construction and Analysis of Systems , 2018, Lecture Notes in Computer Science.

[8]  Marta Z. Kwiatkowska,et al.  The PRISM Benchmark Suite , 2012, 2012 Ninth International Conference on Quantitative Evaluation of Systems.

[9]  David S. Rosenblum,et al.  Perturbation analysis of stochastic systems with empirical distribution parameters , 2014, ICSE.

[10]  David S. Rosenblum,et al.  Reliability prediction in model-driven development , 2005, MoDELS'05.

[11]  Bengt Jonsson,et al.  A logic for reasoning about time and reliability , 1990, Formal Aspects of Computing.

[12]  Carlo Ghezzi,et al.  Self-adaptive software needs quantitative verification at runtime , 2012, CACM.

[13]  Mahesh Viswanathan,et al.  Model-Checking Markov Chains in the Presence of Uncertainties , 2006, TACAS.

[14]  V. N. Bogaevski,et al.  Matrix Perturbation Theory , 1991 .

[15]  Joost-Pieter Katoen,et al.  LTL Model Checking of Time-Inhomogeneous Markov Chains , 2009, ATVA.

[16]  Marta Z. Kwiatkowska,et al.  Automated Verification Techniques for Probabilistic Systems , 2011, SFM.

[17]  Taolue Chen,et al.  On the complexity of model checking interval-valued discrete time Markov chains , 2013, Inf. Process. Lett..

[18]  David S. Rosenblum,et al.  Perturbation Analysis in Verification of Discrete-Time Markov Chains , 2014, CONCUR.

[19]  Carlo Ghezzi,et al.  Managing non-functional uncertainty via model-driven adaptivity , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[20]  Patricia Bouyer,et al.  Robust Model-Checking of Linear-Time Properties in Timed Automata , 2006, LATIN.

[21]  Lijun Zhang,et al.  Probabilistic Reachability for Parametric Markov Models , 2009, SPIN.

[22]  Lijun Zhang,et al.  Synthesis for PCTL in Parametric Markov Decision Processes , 2011, NASA Formal Methods.

[23]  Sandeep K. Shukla,et al.  Evaluating the reliability of NAND multiplexing with PRISM , 2005, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[24]  Christel Baier,et al.  Principles of model checking , 2008 .

[25]  Roger C. Cheung,et al.  A User-Oriented Software Reliability Model , 1978, IEEE Transactions on Software Engineering.

[26]  Jean B. Lasserre,et al.  Global Optimization with Polynomials and the Problem of Moments , 2000, SIAM J. Optim..

[27]  Grégoire Sutre,et al.  An Optimal Automata Approach to LTL Model Checking of Probabilistic Systems , 2003, LPAR.

[28]  Alberto L. Sangiovanni-Vincentelli,et al.  Polynomial-Time Verification of PCTL Properties of MDPs with Convex Uncertainties , 2013, CAV.

[29]  Thomas Wilke,et al.  Complementation, Disambiguation, and Determinization of Büchi Automata Unified , 2008, ICALP.

[30]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[31]  Krishnendu Chatterjee,et al.  Model-Checking omega-Regular Properties of Interval Markov Chains , 2008, FoSSaCS.

[32]  James Worrell,et al.  LTL Model Checking of Interval Markov Chains , 2013, TACAS.

[33]  Tosio Kato Perturbation theory for linear operators , 1966 .

[34]  David S. Rosenblum,et al.  Using Scenarios to Predict the Reliability of Concurrent Component-Based Software Systems , 2005, FASE.

[35]  Conrado Daws Symbolic and Parametric Model Checking of Discrete-Time Markov Chains , 2004, ICTAC.

[36]  B. Heidergott Perturbation analysis of Markov chains , 2008, 2008 9th International Workshop on Discrete Event Systems.

[37]  Marta Z. Kwiatkowska,et al.  PRISM 4.0: Verification of Probabilistic Real-Time Systems , 2011, CAV.

[38]  Lars Grunske,et al.  Evaluating probabilistic models with uncertain model parameters , 2012, Software & Systems Modeling.

[39]  Eric Allender,et al.  Relationships among PL, #L, and the determinant , 1994, Proceedings of IEEE 9th Annual Conference on Structure in Complexity Theory.

[40]  U. Rieder,et al.  Markov Decision Processes , 2010 .

[41]  Vineet Kahlon,et al.  Efficient Probabilistic Model Checking of Systems with Ranged Probabilities , 2012, RP.

[42]  Lijun Zhang,et al.  Model Repair for Markov Decision Processes , 2013, 2013 International Symposium on Theoretical Aspects of Software Engineering.

[43]  C. R. Ramakrishnan,et al.  Model Repair for Probabilistic Systems , 2011, TACAS.

[44]  Vincenzo Grassi,et al.  A Modeling Approach to Analyze the Impact of Error Propagation on Reliability of Component-Based Systems , 2007, CBSE.

[45]  David S. Rosenblum,et al.  Asymptotic Bounds for Quantitative Verification of Perturbed Probabilistic Systems , 2013, ICFEM.

[46]  David R. Gilbert,et al.  A Model Checking Approach to the Parameter Estimation of Biochemical Pathways , 2008, CMSB.

[47]  Christel Baier,et al.  Model-Checking Algorithms for Continuous-Time Markov Chains , 2002, IEEE Trans. Software Eng..

[48]  Sartaj Sahni,et al.  Computationally Related Problems , 1974, SIAM J. Comput..

[49]  Mihalis Yannakakis,et al.  The complexity of probabilistic verification , 1995, JACM.

[50]  Eric Allender,et al.  Relationships Among PL, #L, and the Determinant , 1996, RAIRO Theor. Informatics Appl..

[51]  C. D. Meyer,et al.  Comparison of perturbation bounds for the stationary distribution of a Markov chain , 2001 .

[52]  P. S. Thiagarajan,et al.  Approximate Verification of the Symbolic Dynamics of Markov Chains , 2012, 2012 27th Annual IEEE Symposium on Logic in Computer Science.

[53]  David S. Rosenblum,et al.  Nested Reachability Approximation for Discrete-Time Markov Chains with Univariate Parameters , 2014, ATVA.

[54]  Sebastián Uchitel,et al.  Automated reliability estimation over partial systematic explorations , 2013, 2013 35th International Conference on Software Engineering (ICSE).