Statistical Approaches for Probabilistic Model Checking

In this dissertation, we survey the different techniques used to perform statistical probabilistic model checking, prove their respective validity and compare them in terms of (statistical) reliability. We then propose some extensions of these methods for computation of rewards, which to our knowledge has not been done before. All these strategies are added to the code of the probabilistic model checking tool PRISM, and we experiment them on several large biological model examples. We conclude by some recommendations for the practical use of these methods, based on the experiments observation and the methods comparisons. 1 Acknowledgements I would like to thank Dr David Parker for the supervision of this thesis. He proposed me an interesting and challenging subject, introduced the PRISM code to me, proofread this dissertation and was always present to advise me in the direction to give to my researches. During this project, I studied a part of the method that APMC implements, and I really appreciated the explanations of Dr Sylvain Peyronnet about this and the choices he and his team made when they wrote this software. I am grateful to Mr Bernard Sufrin for the supervision of my Master in general and for his advice and discussions all along the year. I would also like to thank my French engineering school, the École Nationale Supérieure pour l'Industrie et l'Entreprise (ENSIIE), for offering me the opportunity to follow this Master of Science in the University of Oxford. Finally, many thanks to my family, my friends and all the people in the Computing Laboratory for their smiles, their kindness and their support.

[1]  Håkan L. S. Younes,et al.  Numerical vs. statistical probabilistic model checking , 2006, International Journal on Software Tools for Technology Transfer.

[2]  Andrew Chi-Chih Yao,et al.  The complexity of nonuniform random number generation , 1976 .

[3]  V. Bentkus,et al.  An extension of the Hoeffding inequality to unbounded random variables , 2008 .

[4]  Marie Duflot,et al.  A formal analysis of bluetooth device discovery , 2006, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[5]  Edmund M. Clarke,et al.  Bayesian statistical model checking with application to Stateflow/Simulink verification , 2010, Formal Methods in System Design.

[6]  Thomas A. Henzinger,et al.  Approximation of event probabilities in noisy cellular processes , 2011, Theor. Comput. Sci..

[7]  Averill M. Law,et al.  Simulation modelling and analysis , 1991 .

[8]  Marta Z. Kwiatkowska,et al.  Probabilistic model checking of complex biological pathways , 2008, Theor. Comput. Sci..

[9]  Lawrence L. Kupper,et al.  How Appropriate are Popular Sample Size Formulas , 1989 .

[10]  Mahesh Viswanathan,et al.  On Statistical Model Checking of Stochastic Systems , 2005, CAV.

[11]  Zhi-Cheng Wang,et al.  Probability Inequalities for Sums of Independent Unbounded Random Variables , 2001 .

[12]  Marta Z. Kwiatkowska,et al.  Stochastic Model Checking , 2007, SFM.

[13]  G. Lugosi Concentration-of-measure inequalities Lecture notes by Gábor Lugosi , 2005 .

[14]  Paola Lecca,et al.  Cell Cycle Control in Eukaryotes: A BioSpi model , 2007, Electron. Notes Theor. Comput. Sci..

[15]  Richard Lassaigne,et al.  Probabilistic verification and approximation , 2008, Ann. Pure Appl. Log..

[16]  S. Leibler,et al.  Mechanisms of noise-resistance in genetic oscillators , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Axel Legay,et al.  A Bayesian Approach to Model Checking Biological Systems , 2009, CMSB.

[18]  Christel Baier,et al.  Principles of model checking , 2008 .

[19]  Kishor S. Trivedi,et al.  Stochastic Petri Net Models of Polling Systems , 1990, IEEE J. Sel. Areas Commun..

[20]  Joost-Pieter Katoen,et al.  On the use of model checking techniques for dependability evaluation , 2000, Proceedings 19th IEEE Symposium on Reliable Distributed Systems SRDS-2000.

[21]  Phillip I. Good,et al.  Common Errors in Statistics (and How to Avoid Them) , 2003 .

[22]  Daniel R Jeske,et al.  Sequential Hypothesis Testing Techniques for Pest Count Models with Nuisance Parameters , 2009, Journal of economic entomology.

[23]  S. Leibler,et al.  Biological rhythms: Circadian clocks limited by noise , 2000, Nature.

[24]  Thomas Hérault,et al.  Approximate Probabilistic Model Checking , 2004, VMCAI.

[25]  Mahesh Viswanathan,et al.  Statistical Model Checking of Black-Box Probabilistic Systems , 2004, CAV.

[26]  W. Hoeffding Probability Inequalities for sums of Bounded Random Variables , 1963 .

[27]  Amir Pnueli,et al.  Verification of multiprocess probabilistic protocols , 1984, PODC '84.

[28]  Marta Z. Kwiatkowska,et al.  Probabilistic model checking of complex biological pathways , 2008, Theor. Comput. Sci..

[29]  P. Massart,et al.  Concentration inequalities and model selection , 2007 .

[30]  Werner Sandmann,et al.  ON THE STATISTICAL ACCURACY OF STOCHASTIC SIMULATION ALGORITHMS IMPLEMENTED IN DIZZY , 2008 .