CONDITIONAL ERGODICITY IN INFINITE DIMENSION

The goal of this paper is to develop a general method to establish conditional ergodicity of infinite-dimensional Markov chains. Given a Markov chain in a product space, we aim to understand the ergodic properties of its conditional distributions given one of the components. Such questions play a fundamental role in the ergodic theory of nonlinear filters. In the setting of Harris chains, conditional ergodicity has been established under general nondegeneracy assumptions. Unfortunately, Markov chains in infinite-dimensional state spaces are rarely amenable to the classical theory of Harris chains due to the singularity of their transition probabilities, while topological and functional methods that have been developed in the ergodic theory of infinite-dimensional Markov chains are not well suited to the investigation of conditional distributions. We must therefore develop new measure-theoretic tools in the ergodic theory of Markov chains that enable the investigation of conditional ergodicity for infinite dimensional or weak-* ergodic processes. To this end, we first develop local counterparts of zero-two laws that arise in the theory of Harris chains. These results give rise to ergodic theorems for Markov chains that admit asymptotic couplings or that are locally mixing in the sense of H. F\"{o}llmer, and to a non-Markovian ergodic theorem for stationary absolutely regular sequences. We proceed to show that local ergodicity is inherited by conditioning on a nondegenerate observation process. This is used to prove stability and unique ergodicity of the nonlinear filter. Finally, we show that our abstract results can be applied to infinite-dimensional Markov processes that arise in several settings, including dissipative stochastic partial differential equations, stochastic spin systems and stochastic differential delay equations.

[1]  Sheldon M. Ross,et al.  Stochastic Processes , 2018, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.

[2]  Armen Shirikyan,et al.  Mathematics of Two-Dimensional Turbulence , 2012 .

[3]  J. Stoyanov The Oxford Handbook of Nonlinear Filtering , 2012 .

[4]  C. Dellacherie,et al.  Probabilities and Potential B: Theory of Martingales , 2012 .

[5]  Ramon van Handel,et al.  Ergodicity and stability of the conditional distributions of nondegenerate markov chains , 2011, 1101.1822.

[6]  R. Handel On the exchange of intersection and supremum of σ-fields in filtering theory , 2010, 1009.0507.

[7]  Andrew M. Stuart,et al.  Inverse problems: A Bayesian perspective , 2010, Acta Numerica.

[8]  Ramon van Handel,et al.  A complete solution to Blackwell's unique ergodicity problem for hidden Markov chains , 2009, ArXiv.

[9]  O. Gaans,et al.  Invariant measures for stochastic functional differential equations with superlinear drift term , 2009, Differential and Integral Equations.

[10]  Jonathan C. Mattingly,et al.  Asymptotic coupling and a general form of Harris’ theorem with applications to stochastic delay equations , 2009, 0902.4495.

[11]  R. Handel Uniform time average consistency of Monte Carlo particle filters , 2008, 0812.0350.

[12]  Tomasz Szarek,et al.  On ergodicity of some Markov processes , 2008, 0810.4609.

[13]  Ramon van Handel,et al.  Uniform observability of hidden Markov models and filter stability for unstable signals , 2008, 0804.2885.

[14]  Ramon van Handel,et al.  The stability of conditional Markov processes and Markov chains in random environments , 2008, 0801.4366.

[15]  Patrick Florchinger,et al.  Convergence in Nonlinear Filtering for Stochastic Delay Systems , 2007, SIAM J. Control. Optim..

[16]  Jonathan C. Mattingly,et al.  Ergodicity of the 2D Navier-Stokes equations with degenerate stochastic forcing , 2004, math/0406087.

[17]  D. Rudolph Pointwise and $L\sp 1$ mixing relative to a sub-sigma algebra , 2004 .

[18]  Gerry Leversha,et al.  Foundations of modern probability (2nd edn), by Olav Kallenberg. Pp. 638. £49 (hbk). 2002. ISBN 0 387 95313 2 (Springer-Verlag). , 2004, The Mathematical Gazette.

[19]  Amarjit Budhiraja,et al.  Asymptotic stability, ergodicity and other asymptotic properties of the nonlinear filter , 2003 .

[20]  Jonathan C. Mattingly Exponential Convergence for the Stochastically Forced Navier-Stokes Equations and Other Partially Dissipative Dynamics , 2002 .

[21]  Jonathan C. Mattingly,et al.  Ergodicity for the Navier‐Stokes equation with degenerate random forcing: Finite‐dimensional approximation , 2001 .

[22]  Weinan E,et al.  Gibbsian Dynamics and Ergodicity¶for the Stochastically Forced Navier–Stokes Equation , 2001 .

[23]  T. Kurtz Martingale Problems for Conditional Distributions of Markov Processes , 1998 .

[24]  K. Elworthy ERGODICITY FOR INFINITE DIMENSIONAL SYSTEMS (London Mathematical Society Lecture Note Series 229) By G. Da Prato and J. Zabczyk: 339 pp., £29.95, LMS Members' price £22.47, ISBN 0 521 57900 7 (Cambridge University Press, 1996). , 1997 .

[25]  J. Zabczyk,et al.  Ergodicity for Infinite Dimensional Systems: Invariant measures for stochastic evolution equations , 1996 .

[26]  Torgny Lindvall Lectures on the Coupling Method , 1992 .

[27]  Steven Orey,et al.  Markov Chains with Stochastically Stationary Transition Probabilities , 1991 .

[28]  Daniel W. Stroock,et al.  Uniform andL2 convergence in one dimensional stochastic Ising models , 1989 .

[29]  R. Cogburn The ergodic theory of Markov chains in random environments , 1984 .

[30]  D. Newton AN INTRODUCTION TO ERGODIC THEORY (Graduate Texts in Mathematics, 79) , 1982 .

[31]  J. Pachl Measures as functionals on uniformly continuous functions. , 1979 .

[32]  Alan S. Willsky,et al.  Estimation and filter stability of stochastic delay systems , 1978 .

[33]  P. Walters Introduction to Ergodic Theory , 1977 .

[34]  R. Vinter Filter stability for stochastic evolution equations , 1976, 1976 IEEE Conference on Decision and Control including the 15th Symposium on Adaptive Processes.

[35]  E. Çinlar Markov additive processes. II , 1972 .

[36]  H. Kunita Asymptotic behavior of the nonlinear filtering errors of Markov processes , 1971 .

[37]  D. Ornstein,et al.  An Operator Theorem on $L_1$ Convergence to Zero with Applications to Markov Kernels , 1970 .

[38]  D. Blackwell,et al.  Merging of Opinions with Increasing Information , 1962 .

[39]  M. Bartlett,et al.  Weak ergodicity in non-homogeneous Markov chains , 1958, Mathematical Proceedings of the Cambridge Philosophical Society.

[40]  M. Mirzakhani,et al.  Introduction to Ergodic theory , 2010 .

[41]  Fabio Martinelli,et al.  Relaxation Times of Markov Chains in Statistical Mechanics and Combinatorial Structures , 2004 .

[42]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[43]  L. Stettner On invariant measures of filtering processes , 1989 .

[44]  P. Ney GENERAL IRREDUCIBLE MARKOV CHAINS AND NON‐NEGATIVE OPERATORS (Cambridge Tracts in Mathematics, 83) , 1986 .

[45]  H. Berbee Periodicity and absolute regularity , 1983 .

[46]  H. Weizsäcker Exchanging the order of taking suprema and countable intersections of $\sigma $-algebras , 1983 .

[47]  K. Brown,et al.  Graduate Texts in Mathematics , 1982 .

[48]  Hans Föllmer,et al.  Tail structure of markov chains on infinite product spaces , 1979 .

[49]  P. Meyer,et al.  Probabilities and potential C , 1978 .

[50]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Statistics of random processes , 1977 .

[51]  M. Yor Sur les théories du filtrage et de la prédiction , 1977 .

[52]  Y. Derriennic Lois «zéro ou deux» pour les processus de Markov. Applications aux marches aléatoires , 1976 .

[53]  E. Çinlar Markov additive processes. I , 1972 .

[54]  V. Volkonskii,et al.  Some Limit Theorems for Random Functions. II , 1959 .