Model reduction of continuous-time stochastic linear control systems via bisimulation equivalence

In this paper we consider continuous-time stochastic linear control systems and propose model reduction techniques which are based on the notion of equivalence via stochastic bisimulation. Starting from our earlier work on equivalences given for discrete-time stochastic control systems we first extend the notion of stochastic bisimulation equivalence and the corresponding geometric conditions to the present framework. We then define the quotient linear systems induced by the equivalence notion and show that the obtained system is equivalent via stochastic bisimulation to the original one. We finally discuss model reduction to the system with minimal dimension in the state space.

[1]  Arjan van der Schaft,et al.  Communicating piecewise deterministic Markov processes , 2006 .

[2]  A. J. van der Schaft,et al.  Equivalence of switching linear systems by bisimulation , 2006 .

[3]  Majid Zamani,et al.  Construction of approximations of stochastic control systems: A compositional approach , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[4]  Arjan van der Schaft,et al.  Communicating Piecewise Deterministic Markov Processes , 2003, ADHS.

[5]  Maria Domenica Di Benedetto,et al.  On external behavior equivalence of continuous-time stochastic linear control systems , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[6]  A. J. van der Schaft Equivalence of dynamical systems by bisimulation , 2004, IEEE Transactions on Automatic Control.

[7]  Kim G. Larsen,et al.  Bisimulation through Probabilistic Testing , 1991, Inf. Comput..

[8]  John Lygeros,et al.  Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems , 2008, Autom..

[9]  R. J. vanGlabbeek The linear time - branching time spectrum , 1990 .

[10]  Radha Jagadeesan,et al.  Metrics for labelled Markov processes , 2004, Theor. Comput. Sci..

[11]  John Lygeros,et al.  Symbolic Control of Stochastic Systems via Approximately Bisimilar Finite Abstractions , 2013, IEEE Transactions on Automatic Control.

[12]  Paulo Tabuada,et al.  Bisimulation relations for dynamical, control, and hybrid systems , 2005, Theor. Comput. Sci..

[13]  Holger Hermanns,et al.  Interactive Markov Chains , 2002, Lecture Notes in Computer Science.

[14]  George J. Pappas,et al.  Approximate bisimulation for a class of stochastic hybrid systems , 2006, 2006 American Control Conference.

[15]  R. Kaiman KRONECKER INVARIANTS AND FEEDBACK , 1972 .

[16]  Arjan van der Schaft,et al.  On equivalence notions for discrete-time stochastic control systems , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[17]  John Lygeros,et al.  Reachability Questions in Piecewise Deterministic Markov Processes , 2003, HSCC.

[18]  John Lygeros,et al.  Invariance in Stochastic Dynamical Control Systems , 2006 .

[19]  Majid Zamani,et al.  Approximations of Stochastic Hybrid Systems: A Compositional Approach , 2015, IEEE Transactions on Automatic Control.

[20]  Arjan van der Schaft,et al.  Bisimulation for Communicating Piecewise Deterministic Markov Processes (CPDPs) , 2005, HSCC.

[21]  John Lygeros,et al.  Bisimulation for General Stochastic Hybrid Systems , 2005, HSCC.

[22]  Rob J. van Glabbeek,et al.  The Linear Time - Branching Time Spectrum I , 2001, Handbook of Process Algebra.