A formal mathematical framework for modeling probabilistic hybrid systems

The development of autonomous agents, such as mobile robots and software agents, has generated considerable research in recent years. Robotic systems, which are usually built from a mixture of continuous (analog) and discrete (digital) components, are often referred to as hybrid dynamical systems. Traditional approaches to real-time hybrid systems usually define behaviors purely in terms of determinism or sometimes non-determinism. However, this is insufficient as real-time dynamical systems very often exhibit uncertain behavior. To address this issue, we develop a semantic model, Probabilistic Constraint Nets (PCN), for probabilistic hybrid systems. PCN captures the most general structure of dynamic systems, allowing systems with discrete and continuous time/variables, synchronous as well as asynchronous event structures and uncertain dynamics to be modeled in a unitary framework. Based on a formal mathematical paradigm exploiting abstract algebra, topology and measure theory, PCN provides a rigorous formal programming semantics for the design of hybrid real-time embedded systems exhibiting uncertainty.

[1]  David Williams,et al.  Probability with Martingales , 1991, Cambridge mathematical textbooks.

[2]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[3]  V. Ugrinovskii.  Robust H∞ infinity control in the presence of stochastic uncertainty , 1998 .

[4]  Robert St-Aubin.  Probabilistic constraint nets: a formal framework for the modeling and verification of probabilistic hybrid systems , 2005 .

[5]  A. S. Hodel,et al.  Homotopy methods for the solution of general modified algebraic Riccati equations , 1993 .

[6]  Paul Bratley,et al.  A guide to simulation , 1983 .

[7]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[8]  S. Vickers.  Topology via Logic , 1989 .

[9]  Chun-Hua Guo,et al.  Iterative Solution of a Matrix Riccati Equation Arising in Stochastic Control , 2002 .

[10]  Robert L. Grossman,et al.  Timed Automata , 1999, CAV.

[11]  W. Wonham.  On a Matrix Riccati Equation of Stochastic Control , 1968 .

[12]  P. Rousseeuw,et al.  Wiley Series in Probability and Mathematical Statistics , 2005 .

[13]  Howard Barringer.  Up and Down The Temporal Wey , 1987, Comput. J..

[14]  G. Zames.  Feedback and optimal sensitivity: Model reference transformations, multiplicative seminorms, and approximate inverses , 1981 .

[15]  Brian C. Williams,et al.  Gaussian Particle Filtering for Concurrent Hybrid Models Gaussian Particle Filtering for Concurrent Hybrid Models with Autonomous Transitions , 2004 .

[16]  James Lyle Peterson,et al.  Petri net theory and the modeling of systems , 1981 .

[17]  Michael A. Arbib,et al.  Algebraic Approaches to Program Semantics , 1986, Texts and Monographs in Computer Science.

[18]  G. Maruyama.  Continuous Markov processes and stochastic equations , 1955 .

[19]  Zohar Manna,et al.  From Timed to Hybrid Systems , 1991, REX Workshop.

[20]  V. Ugrinovskii.  Robust H 2 control in the presence of stochastic uncertainty , 2001 .

[21]  Kurt Jensen,et al.  Coloured Petri Nets and the Invariant-Method , 1981, Theor. Comput. Sci..

[22]  Michael Beetz,et al.  Probabilistic Hybrid Action Models for Predicting Concurrent Percept-Driven Robot Behavior , 2000, AIPS.

[23]  Matthew Hennessy,et al.  Algebraic theory of processes , 1988, MIT Press series in the foundations of computing.

[24]  J. Gentle.  Random number generation and Monte Carlo methods , 1998 .

[25]  Alan K. Mackworth,et al.  Modeling and Analysis of Hybrid Control Systems , 1999 .

[26]  Ying Zhang,et al.  Constraint Nets: A Semantic Model for Hybrid Dynamic Systems , 1995, Theor. Comput. Sci..

[27]  Anil Nerode,et al.  Models for Hybrid Systems: Automata, Topologies, Controllability, Observability , 1992, Hybrid Systems.

[28]  Linus Schrage,et al.  A guide to simulation , 1983 .

[29]  J. Warga.  Optimal control of differential and functional equations , 1972 .

[30]  Ying Zhang,et al.  Modeling and Analysis of Hybrid Control Systems An Elevator Case Study , 1999 .

[31]  D. Hinrichsen,et al.  Newton's method for a rational matrix equation occurring in stochastic control , 2001 .

[32]  Peter E. Caines,et al.  The logical control of an elevator , 1995, IEEE Trans. Autom. Control..

[33]  Ian R. Petersen,et al.  Robust Control Design Using H-infinity Methods , 2000 .

[34]  A. Tarski.  A LATTICE-THEORETICAL FIXPOINT THEOREM AND ITS APPLICATIONS , 1955 .

[35]  Bo Ingvar Sandén,et al.  An entity-life modeling approach to the design of concurrent software , 1989, Commun. ACM.

[36]  W. Rudin.  Real and complex analysis , 1968 .

[37]  Brian C. Williams,et al.  Hybrid estimation of complex systems , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[38]  Paul Bratley,et al.  A guide to simulation (2nd ed.) , 1986 .

[39]  Michael C. Horsch,et al.  Dynamic Bayesian networks , 1990 .

[40]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[41]  G. Casella,et al.  Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.