Probabilistic Reachability for Uncertain Stochastic Hybrid Systems via Gaussian Processes

Cyber-physical system models often feature stochastic behaviour that itself depends on uncertain parameters (e.g., transition rates). For these systems, verifying reachability amounts to computing a range of probabilities depending on how uncertainty is resolved. In general, this is a hard problem for which rigorous solutions suffer from the well-known curse of dimensionality. In this paper we focus on hybrid systems with random parameters whose distribution is subject to nondeterministic uncertainty. We show that for these systems the reachability probability is a smooth function of the nondeterministic parameters, and thus Gaussian processes can be used to approximate the reachability probability function itself very efficiently over its entire domain. Furthermore, we introduce a novel approach that exploits rigorous probability enclosures for training Gaussian processes. We apply our approaches to non-trivial hybrid systems case studies, and we empirically demonstrate their advantages with respect to standard statistical model checking.

[1]  Zohar Manna,et al.  From Timed to Hybrid Systems , 1991, REX Workshop.

[2]  Guido Sanguinetti,et al.  A Statistical Approach for Computing Reachability of Non-linear and Stochastic Dynamical Systems , 2014, QEST.

[3]  Ezio Bartocci,et al.  System design of stochastic models using robustness of temporal properties , 2015, Theor. Comput. Sci..

[4]  Luca Bortolussi,et al.  Smoothed model checking for uncertain Continuous-Time Markov Chains , 2014, Inf. Comput..

[5]  Bai Xue,et al.  Probably Approximate Safety Verification of Hybrid Dynamical Systems , 2019, ICFEM.

[6]  I. Sobol On the distribution of points in a cube and the approximate evaluation of integrals , 1967 .

[7]  Martin Fränzle,et al.  Statistical model checking for stochastic hybrid systems involving nondeterminism over continuous domains , 2014, International Journal on Software Tools for Technology Transfer.

[8]  Edmund M. Clarke,et al.  dReal: An SMT Solver for Nonlinear Theories over the Reals , 2013, CADE.

[9]  Paolo Zuliani,et al.  Probabilistic Hybrid Systems Verification via SMT and Monte Carlo Techniques , 2016, Haifa Verification Conference.

[10]  E. S. Pearson,et al.  THE USE OF CONFIDENCE OR FIDUCIAL LIMITS ILLUSTRATED IN THE CASE OF THE BINOMIAL , 1934 .

[11]  Bernardete Ribeiro,et al.  Gaussian Process Classification and Active Learning with Multiple Annotators , 2014, ICML.

[12]  A. Tarski A Decision Method for Elementary Algebra and Geometry , 2023 .

[13]  Paolo Zuliani,et al.  ProbReach: verified probabilistic delta-reachability for stochastic hybrid systems , 2014, HSCC.

[14]  Edmund M. Clarke,et al.  Satisfiability modulo ODEs , 2013, 2013 Formal Methods in Computer-Aided Design.

[15]  Iain Murray Introduction To Gaussian Processes , 2008 .

[16]  Hong Zhang,et al.  Modelling epidermis homoeostasis and psoriasis pathogenesis , 2013, Journal of The Royal Society Interface.

[17]  Tom Minka,et al.  Expectation Propagation for approximate Bayesian inference , 2001, UAI.

[18]  Paolo Zuliani,et al.  SMT-Based Reasoning for Uncertain Hybrid Domains , 2016, AAAI Workshop: Planning for Hybrid Systems.

[19]  Ian M. Mitchell,et al.  Benchmark Problem: A PK/PD Model and Safety Constraints for Anesthesia Delivery , 2014, ARCH@CPSWeek.

[20]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[21]  Martin Fränzle,et al.  SAT Modulo ODE: A Direct SAT Approach to Hybrid Systems , 2008, ATVA.

[22]  OpperManfred,et al.  Gaussian Processes for Classification: Mean-Field Algorithms , 2000 .

[23]  Xenofon D. Koutsoukos,et al.  Online Model Learning of Buildings Using Stochastic Hybrid Systems Based on Gaussian Processes , 2017, J. Control. Sci. Eng..

[24]  Thomas A. Henzinger,et al.  Hybrid Automata: An Algorithmic Approach to the Specification and Verification of Hybrid Systems , 1992, Hybrid Systems.

[25]  Edmund M. Clarke,et al.  Delta-Decidability over the Reals , 2012, 2012 27th Annual IEEE Symposium on Logic in Computer Science.

[26]  Ker-I Ko,et al.  Complexity Theory of Real Functions , 1991, Progress in Theoretical Computer Science.

[27]  Martin Fränzle,et al.  In memory of Oded Maler: automatic reachability analysis of hybrid-state automata , 2019, SIGL.

[28]  Fedor Shmarov,et al.  Probabilistic bounded reachability for stochastic hybrid systems , 2018 .