Conditions for weak ergodicity of inhomogeneous Markov chains

A classical result of Wolfowitz states that an inhomogeneous Markov chain is weakly ergodic if the transition matrices are drawn from a finite set of indecomposable and aperiodic matrices and the products of transition matrices are also indecomposable and aperiodic. Since products of indecomposable and aperiodic matrices can be decomposable, any finite set of indecomposable and aperiodic transition matrices does not guarantee weak ergodicity. We present conditions for weak ergodicity which are simpler to verify and are related to properties of the graph of the transition matrices.

[1]  M. Bartlett,et al.  Weak ergodicity in non-homogeneous Markov chains , 1958, Mathematical Proceedings of the Cambridge Philosophical Society.

[2]  Dieter Jungnickel,et al.  Graphs, Networks, and Algorithms , 1980 .

[3]  H. Tijms,et al.  Exponential convergence of products of stochastic matrices , 1977 .

[4]  Luc Moreau,et al.  Leaderless coordination via bidirectional and unidirectional time-dependent communication , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[5]  Chai Wah Wu.  Agreement and consensus problems in groups of autonomous agents with linear dynamics , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[6]  E. Seneta,et al.  On the historical development of the theory of finite inhomogeneous Markov chains , 1973, Mathematical Proceedings of the Cambridge Philosophical Society.

[7]  Azaria Paz,et al.  Introduction to Probabilistic Automata , 1971 .

[8]  E. Seneta,et al.  Towards consensus: some convergence theorems on repeated averaging , 1977, Journal of Applied Probability.

[9]  C. Wu.  On bounds of extremal eigenvalues of irreducible and m-reducible matrices , 2005 .

[10]  J. Wolfowitz.  Products of indecomposable, aperiodic, stochastic matrices , 1963 .

[11]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[12]  Jianhong Shen.  A Geometric Approach to Ergodic Non-Homogeneous Markov Chains , 2000 .