On equivalence notions for discrete-time stochastic control systems

In this paper we propose definitions of equivalence via stochastic bisimulation and of equivalence of stochastic external behavior for the class of discrete-time stochastic nonlinear control systems with possibly degenerate distributed disturbances. The notions are inspired by the analogue notions that exist for probabilistic chains and for behavioral systems, respectively. Connections between the two notions and also with stochastic reachability are discussed. For the subclass of discrete-time stochastic linear control systems with multivariate possibly degenerate normal distributed disturbances, geometric necessary and sufficient conditions for checking stochastic bisimulation equivalence and stochastic external behavior equivalence are derived. The proposed results nicely extend the theory of bisimulation equivalence and equivalence of external behavior known for non-deterministic control systems to a stochastic setting.

[1]  Arjan van der Schaft,et al.  Communicating Piecewise Deterministic Markov Processes , 2003, ADHS.

[2]  John Lygeros,et al.  Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems , 2008, Autom..

[3]  John Lygeros,et al.  Invariance in Stochastic Dynamical Control Systems , 2006 .

[4]  Jochen Schroder,et al.  Modelling, State Observation, and Diagnosis of Quantised Systems , 2002 .

[5]  George J. Pappas,et al.  Discrete abstractions of hybrid systems , 2000, Proceedings of the IEEE.

[6]  Jeffrey S. Rosenthal,et al.  Introduction to mathematical systems theory. a behavioral approach [Book Review] , 2002, IEEE Transactions on Automatic Control.

[7]  Gunther Reissig.  Computation of Discrete Abstractions of Arbitrary Memory Span for Nonlinear Sampled Systems , 2009, HSCC.

[8]  Abbas Edalat,et al.  Bisimulation for Labelled Markov Processes , 2002, Inf. Comput..

[9]  Holger Hermanns,et al.  Interactive Markov Chains , 2002, Lecture Notes in Computer Science.

[10]  George J. Pappas,et al.  Approximations of Stochastic Hybrid Systems , 2009, IEEE Transactions on Automatic Control.

[11]  Maria Domenica Di Benedetto,et al.  Symbolic Models and Control of Discrete-Time Piecewise Affine Systems: An Approximate Simulation Approach , 2014, IEEE Transactions on Automatic Control.

[12]  Arjan van der Schaft,et al.  Communicating piecewise deterministic Markov processes , 2006 .

[13]  Antoine Girard,et al.  Approximation Metrics for Discrete and Continuous Systems , 2006, IEEE Transactions on Automatic Control.

[14]  Robin Milner,et al.  Communication and concurrency , 1989, PHI Series in computer science.

[15]  Albert Benveniste,et al.  Toward an Approximation Theory for Computerised Control , 2002, EMSOFT.

[16]  A. J. van der Schaft,et al.  Equivalence of switching linear systems by bisimulation , 2006 .

[17]  Alessandro Abate,et al.  Approximately bisimilar symbolic models for randomly switched stochastic systems , 2014, Syst. Control. Lett..

[18]  Sanam Mirzazad-Barijough,et al.  Stability and Transient Performance of Discrete-Time Piecewise Affine Systems , 2012, IEEE Transactions on Automatic Control.

[19]  Calin Belta,et al.  Temporal logic control of discrete-time piecewise affine systems , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[20]  Maria Domenica Di Benedetto,et al.  Networked Embedded Control Systems: from Modelling to Implementation , 2013, HAS.

[21]  Antoine Girard,et al.  Approximate Bisimulation: A Bridge Between Computer Science and Control Theory , 2011, Eur. J. Control.

[22]  Luca de Alfaro,et al.  Linear and Branching Metrics for Quantitative Transition Systems , 2004, ICALP.

[23]  L. M. Bujorianu,et al.  Approximate Abstractions of Stochastic Hybrid Systems , 2008 .

[24]  Joël Ouaknine,et al.  An Intrinsic Characterization of Approximate Probabilistic Bisimilarity , 2003, FoSSaCS.

[25]  Arjan van der Schaft,et al.  Bisimulation for Communicating Piecewise Deterministic Markov Processes (CPDPs) , 2005, HSCC.

[26]  John Lygeros,et al.  Bisimulation for General Stochastic Hybrid Systems , 2005, HSCC.

[27]  Jan Lunze,et al.  Representation of Hybrid Systems by Means of Stochastic Automata , 2001 .

[28]  Paulo Tabuada,et al.  Bisimulation Relations for Dynamical and Control Systems , 2003, CTCS.

[29]  John Lygeros,et al.  Symbolic Control of Stochastic Systems via Approximately Bisimilar Finite Abstractions , 2013, IEEE Transactions on Automatic Control.

[30]  O. Junge,et al.  A set oriented approach to global optimal control , 2004 .

[31]  Paulo Tabuada,et al.  Verification and Control of Hybrid Systems , 2009 .

[32]  John Lygeros,et al.  Reachability Questions in Piecewise Deterministic Markov Processes , 2003, HSCC.

[33]  David Park,et al.  Concurrency and Automata on Infinite Sequences , 1981, Theoretical Computer Science.

[34]  Calin Belta,et al.  Formal Analysis of Discrete-Time Piecewise Affine Systems , 2010, IEEE Transactions on Automatic Control.

[35]  Chris Hankin,et al.  Quantitative Relations and Approximate Process Equivalences , 2003, CONCUR.

[36]  A. J. van der Schaft.  Equivalence of dynamical systems by bisimulation , 2004, IEEE Transactions on Automatic Control.

[37]  Kim G. Larsen,et al.  Bisimulation through Probabilistic Testing , 1991, Inf. Comput..

[38]  R. J. vanGlabbeek.  The linear time - branching time spectrum , 1990 .

[39]  Radha Jagadeesan,et al.  Metrics for labelled Markov processes , 2004, Theor. Comput. Sci..

[40]  Paulo Tabuada,et al.  Verification and Control of Hybrid Systems - A Symbolic Approach , 2009 .