Bayesian Statistical Parameter Synthesis for Linear Temporal Properties of Stochastic Models

Parameterized verification of temporal properties is an active research area, being extremely relevant for model-based design of complex systems. In this paper, we focus on parameter synthesis for stochastic models, looking for regions of the parameter space where the model satisfies a linear time specification with probability greater (or less) than a given threshold. We propose a statistical approach relying on simulation and leveraging a machine learning method based on Gaussian Processes for statistical parametric verification, namely Smoothed Model Checking. By injecting active learning ideas, we obtain an efficient synthesis routine which is able to identify the target regions with statistical guarantees. Our approach, which is implemented in Python, scales better than existing ones with respect to state space of the model and number of parameters. It is applicable to linear time specifications with time constraints and to more complex stochastic models than Markov Chains.

[1]  Ezio Bartocci,et al.  System design of stochastic models using robustness of temporal properties , 2015, Theor. Comput. Sci..

[2]  Lubos Brim,et al.  Precise parameter synthesis for stochastic biochemical systems , 2014, Acta Informatica.

[3]  Sumit Kumar Jha,et al.  Synthesis and infeasibility analysis for stochastic models of biochemical systems using statistical model checking and abstraction refinement , 2011, Theor. Comput. Sci..

[4]  Diego Latella,et al.  Continuous approximation of collective system behaviour: A tutorial , 2013, Perform. Evaluation.

[5]  Håkan L. S. Younes,et al.  Statistical probabilistic model checking with a focus on time-bounded properties , 2006, Inf. Comput..

[6]  J. Collins,et al.  Construction of a genetic toggle switch in Escherichia coli , 2000, Nature.

[7]  Michael Minyi Zhang,et al.  Embarrassingly Parallel Inference for Gaussian Processes , 2017, J. Mach. Learn. Res..

[8]  Dejan Nickovic,et al.  Monitoring Temporal Properties of Continuous Signals , 2004, FORMATS/FTRTFT.

[9]  Andrew Gordon Wilson,et al.  Kernel Interpolation for Scalable Structured Gaussian Processes (KISS-GP) , 2015, ICML.

[10]  Sebastian Junges,et al.  PROPhESY: A PRObabilistic ParamEter SYnthesis Tool , 2015, CAV.

[11]  Ingo Steinwart,et al.  On the Influence of the Kernel on the Consistency of Support Vector Machines , 2002, J. Mach. Learn. Res..

[12]  Axel Legay,et al.  A Bayesian Approach to Model Checking Biological Systems , 2009, CMSB.

[13]  Lubos Brim,et al.  PRISM-PSY: Precise GPU-Accelerated Parameter Synthesis for Stochastic Systems , 2016, TACAS.

[14]  Nicola Paoletti,et al.  Precise Parameter Synthesis for Stochastic Biochemical Systems , 2014, CMSB.

[15]  Alberto Policriti,et al.  Logic-Based Multi-objective Design of Chemical Reaction Networks , 2016, HSB.

[16]  Thomas A. Henzinger,et al.  Formalisms for Specifying Markovian Population Models , 2009, Int. J. Found. Comput. Sci..

[17]  Joost-Pieter Katoen,et al.  Efficient CTMC Model Checking of Linear Real-Time Objectives , 2011, TACAS.

[18]  Siu Kwan Lam,et al.  Numba: a LLVM-based Python JIT compiler , 2015, LLVM '15.

[19]  Marta Z. Kwiatkowska,et al.  PRISM 4.0: Verification of Probabilistic Real-Time Systems , 2011, CAV.

[20]  Joost-Pieter Katoen,et al.  Approximate Parameter Synthesis for Probabilistic Time-Bounded Reachability , 2008, 2008 Real-Time Systems Symposium.

[21]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[22]  Luca Bortolussi,et al.  Smoothed model checking for uncertain Continuous-Time Markov Chains , 2014, Inf. Comput..

[23]  Lubos Brim,et al.  Exploring Parameter Space of Stochastic Biochemical Systems Using Quantitative Model Checking , 2013, CAV.

[24]  Neil D. Lawrence,et al.  Gaussian Process Models with Parallelization and GPU acceleration , 2014, ArXiv.

[25]  Kim G. Larsen,et al.  Optimizing Control Strategy Using Statistical Model Checking , 2013, NASA Formal Methods.

[26]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[27]  Peter J. Haas Stochastic Petri nets for modelling and simulation , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[28]  Joost-Pieter Katoen,et al.  The Probabilistic Model Checking Landscape* , 2016, 2016 31st Annual ACM/IEEE Symposium on Logic in Computer Science (LICS).

[29]  Thomas A. Henzinger,et al.  The benefits of relaxing punctuality , 1991, PODC '91.

[30]  Christel Baier,et al.  Model-Checking Algorithms for Continuous-Time Markov Chains , 2002, IEEE Trans. Software Eng..

[31]  Andrew Gordon Wilson,et al.  Deep Kernel Learning , 2015, AISTATS.