Reliability of Run-Time Quality-of-Service Evaluation Using Parametric Model Checking

Run-time Quality-of-Service (QoS) assurance is crucial for business-critical systems. Complex behavioral performance metrics (PMs) are useful but often difficult to monitor or measure. Probabilistic model checking, especially paramet- ric model checking, can support the computation of aggre- gate functions for a broad range of those PMs. In practice, those PMs may be defined with parameters determined by run-time data. In this paper, we address the reliability of QoS evaluation using parametric model checking. Due to the imprecision with the instantiation of parameters, an evaluation outcome may mislead the judgment about requirement violations. Based on a general assumption of run-time data distribution, we present a novel framework that contains light-weight statistical inference methods to analyze the re- liability of a parametric model checking output with respect to an intuitive criterion. We also present case studies in which we test the stability and accuracy of our inference methods and describe an application of our framework to a cloud server management problem.

[1]  G. Reinsel,et al.  Introduction to Mathematical Statistics (4th ed.). , 1980 .

[2]  Bradley R. Schmerl,et al.  Architecture-based self-adaptation in the presence of multiple objectives , 2006, SEAMS '06.

[3]  Carlo Ghezzi,et al.  Formal Verification With Confidence Intervals to Establish Quality of Service Properties of Software Systems , 2016, IEEE Transactions on Reliability.

[4]  David S. Rosenblum,et al.  Perturbation analysis of stochastic systems with empirical distribution parameters , 2014, ICSE.

[5]  Ambuj Tewari,et al.  Bounded Parameter Markov Decision Processes with Average Reward Criterion , 2007, COLT.

[6]  Salima Benbernou,et al.  A survey on service quality description , 2013, CSUR.

[7]  Conrado Daws.  Symbolic and Parametric Model Checking of Discrete-Time Markov Chains , 2004, ICTAC.

[8]  Carlo Ghezzi,et al.  Managing non-functional uncertainty via model-driven adaptivity , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[9]  DAVID G. KENDALL,et al.  Introduction to Mathematical Statistics , 1947, Nature.

[10]  Christel Baier,et al.  Principles of model checking , 2008 .

[11]  David S. Rosenblum,et al.  Nested Reachability Approximation for Discrete-Time Markov Chains with Univariate Parameters , 2014, ATVA.

[12]  Christel Baier,et al.  Principles of Model Checking (Representation and Mind Series) , 2008 .

[13]  Laurent El Ghaoui,et al.  Robust Control of Markov Decision Processes with Uncertain Transition Matrices , 2005, Oper. Res..

[14]  Allen T. Craig,et al.  Introduction to Mathematical Statistics (6th Edition) , 2005 .

[15]  Radu Calinescu,et al.  Using quantitative analysis to implement autonomic IT systems , 2009, 2009 IEEE 31st International Conference on Software Engineering.

[16]  David S. Rosenblum,et al.  Asymptotic Perturbation Bounds for Probabilistic Model Checking with Empirically Determined Probability Parameters , 2016 .

[17]  Mahesh Viswanathan,et al.  Model-Checking Markov Chains in the Presence of Uncertainties , 2006, TACAS.

[18]  Bengt Jonsson,et al.  A logic for reasoning about time and reliability , 1990, Formal Aspects of Computing.

[19]  Samik Basu,et al.  A two-phase approximation for model checking probabilistic unbounded until properties of probabilistic systems , 2012, TSEM.

[20]  Lijun Zhang,et al.  Probabilistic reachability for parametric Markov models , 2010, International Journal on Software Tools for Technology Transfer.

[21]  Marta Z. Kwiatkowska,et al.  PRISM 4.0: Verification of Probabilistic Real-Time Systems , 2011, CAV.

[22]  Elena Troubitsyna,et al.  Formal Modelling and Verification of Service-Oriented Systems in Probabilistic Event-B , 2012, IFM.

[23]  Carlo Ghezzi,et al.  Supporting Self-Adaptation via Quantitative Verification and Sensitivity Analysis at Run Time , 2016, IEEE Transactions on Software Engineering.

[24]  References , 1971 .

[25]  Robert Givan,et al.  Bounded-parameter Markov decision processes , 2000, Artif. Intell..

[26]  David S. Rosenblum,et al.  Using Scenarios to Predict the Reliability of Concurrent Component-Based Software Systems , 2005, FASE.

[27]  Lijun Zhang,et al.  Model Repair for Markov Decision Processes , 2013, 2013 International Symposium on Theoretical Aspects of Software Engineering.

[28]  David S. Rosenblum,et al.  An Iterative Decision-Making Scheme for Markov Decision Processes and Its Application to Self-adaptive Systems , 2016, FASE.

[29]  Håkan L. S. Younes,et al.  Statistical probabilistic model checking with a focus on time-bounded properties , 2006, Inf. Comput..

[30]  Radu Calinescu,et al.  Dynamic QoS Management and Optimization in Service-Based Systems , 2011, IEEE Transactions on Software Engineering.

[31]  Alberto L. Sangiovanni-Vincentelli,et al.  Polynomial-Time Verification of PCTL Properties of MDPs with Convex Uncertainties , 2013, CAV.

[32]  Albert Benveniste,et al.  QoS-aware management of monotonic service orchestrations , 2014, Formal Methods Syst. Des..

[33]  Lars Grunske,et al.  Lightweight Adaptive Filtering for Efficient Learning and Updating of Probabilistic Models , 2015, 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering.

[34]  Lars Grunske,et al.  Specification patterns for probabilistic quality properties , 2008, 2008 ACM/IEEE 30th International Conference on Software Engineering.

[35]  Jens Palsberg,et al.  Verification, Model Checking, and Abstract Interpretation , 2018, Lecture Notes in Computer Science.

[36]  Thomas Hérault,et al.  Approximate Probabilistic Model Checking , 2004, VMCAI.