Structural transformations of probabilistic finite state machines

Probabilistic finite state machines have recently emerged as a viable tool for modelling and analysis of complex non-linear dynamical systems. This paper rigorously establishes such models as finite encodings of probability measure spaces defined over symbol strings. The well known Nerode equivalence relation is generalized in the probabilistic setting and pertinent results on existence and uniqueness of minimal representations of probabilistic finite state machines are presented. The binary operations of probabilistic synchronous composition and projective composition, which have applications in symbolic model-based supervisory control and in symbolic pattern recognition problems, are introduced. The results are elucidated with numerical examples and are validated on experimental data for statistical pattern classification in a laboratory environment.

[1]  Asok Ray,et al.  Symbolic time series analysis via wavelet-based partitioning , 2006, Signal Process..

[2]  W. Rudin Real and complex analysis , 1968 .

[3]  Cosma Rohilla Shalizi,et al.  Blind Construction of Optimal Nonlinear Recursive Predictors for Discrete Sequences , 2004, UAI.

[4]  Jeffrey D. Ullman,et al.  Introduction to automata theory, languages, and computation, 2nd edition , 2001, SIGA.

[5]  P. Ramadge,et al.  Supervisory control of a class of discrete event processes , 1987 .

[6]  John G. Kemeny,et al.  Finite Markov chains , 1960 .

[7]  A. S. ÜstünelÉcole Stochastic Analysis of the Fractional Brownian Motion , 1996 .

[8]  Ishanu Chattopadhyay Quantitative Control of Probabilistic Discrete Event Systems: A Measure-theoretic Approach , 2006 .

[9]  R. Plemmons,et al.  Comparison of Some Direct Methods for Computing Stationary Distributions of Markov Chains , 1984 .

[10]  RayAsok Symbolic dynamic analysis of complex systems for anomaly detection , 2004 .

[11]  T. Raghavan,et al.  Nonnegative Matrices and Applications , 1997 .

[12]  Vijay K. Garg,et al.  Control of stochastic discrete event systems modeled by probabilistic languages , 2001, IEEE Trans. Autom. Control..

[13]  W. Rudin Real and complex analysis, 3rd ed. , 1987 .

[14]  A. Ray,et al.  Signed real measure of regular languages for discrete event supervisory control , 2005 .

[15]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[16]  L. Decreusefond,et al.  Stochastic Analysis of the Fractional Brownian Motion , 1999 .

[17]  Vijay K. Garg,et al.  An algebraic approach to modeling probabilistic discrete event systems , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[18]  W. M. Wonham,et al.  Supervisory control of probabilistic discrete event systems , 1993, Proceedings of 36th Midwest Symposium on Circuits and Systems.

[19]  Asok Ray,et al.  Symbolic dynamic analysis of complex systems for anomaly detection , 2004, Signal Process..

[20]  A. Ray,et al.  Renormalized measure of regular languages , 2006, 2006 8th International Workshop on Discrete Event Systems.