Asymptotic behavior for Markovian iterated function systems

Abstract Let ( U , d ) be a complete separable metric space and ( F n ) n ≥ 0 a sequence of random functions from U to U . Motivated by studying the stability property for Markovian dynamic models, in this paper, we assume that the random function ( F n ) n ≥ 0 is driven by a Markov chain X = { X n , n ≥ 0 } . Under some regularity conditions on the driving Markov chain and the mean contraction assumption, we show that the forward iterations M n u = F n ∘ ⋯ ∘ F 1 ( u ) , n ≥ 0 , converge weakly to a unique stationary distribution Π for each u ∈ U , where ∘ denotes composition of two maps. The associated backward iterations M n u = F 1 ∘ ⋯ ∘ F n ( u ) are almost surely convergent to a random variable M ∞ which does not depend on u and has distribution Π . Moreover, under suitable moment conditions, we provide estimates and rate of convergence for d ( M ∞ , M n u ) and d ( M n u , M n v ) , u , v ∈ U . The results are applied to the examples that have been discussed in the literature, including random coefficient autoregression models and recurrent neural network.

[1]  Örjan Stenflo,et al.  A survey of average contractive iterated function systems , 2012 .

[2]  Tong Zhou,et al.  Robust Recursive State Estimation With Random Measurement Droppings , 2014, IEEE Transactions on Automatic Control.

[3]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[4]  Chang-Jin Kim,et al.  Business Cycle Turning Points, A New Coincident Index, and Tests of Duration Dependence Based on a Dynamic Factor Model With Regime Switching , 1998, Review of Economics and Statistics.

[5]  J. Karlsson,et al.  Iteration of Möbius transformations and attractors on the real line , 1997 .

[6]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[7]  T. Lai,et al.  WALD'S EQUATIONS, FIRST PASSAGE TIMES AND MOMENTS OF LADDER VARIABLES IN MARKOV RANDOM WALKS , 1998 .

[8]  Poisson equation, moment inequalities and quick convergence for Markov random walks , 2000 .

[9]  Gerold Alsmeyer.  On the Markov renewal theorem , 1994 .

[10]  Persi Diaconis,et al.  Iterated Random Functions , 1999, SIAM Rev..

[11]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[12]  A. A. Borovkov,et al.  Asymptotic Methods in Queueing Theory. , 1986 .

[13]  Moritz Hardt,et al.  Stable Recurrent Models , 2018, ICLR.

[14]  Cheng-Der Fuh.  Uniform Markov Renewal Theory and Ruin Probabilities in Markov Random Walks , 2004 .

[15]  Ulrich Horst.  The stochastic equation Y t+1 = A t Y t + B t with non-stationary coefficients , 2001, Journal of Applied Probability.

[16]  Efficient likelihood estimation in state space models , 2006 .

[17]  Thomas Flynn,et al.  Forward sensitivity analysis for contracting stochastic systems , 2016, Advances in Applied Probability.

[18]  R. M. Loynes,et al.  The stability of a queue with non-independent inter-arrival and service times , 1962, Mathematical Proceedings of the Cambridge Philosophical Society.

[19]  Wei Biao Wu,et al.  Limit theorems for iterated random functions , 2004, Journal of Applied Probability.

[20]  P. Bougerol,et al.  Stationarity of Garch processes and of some nonnegative time series , 1992 .

[21]  Michel Loève,et al.  Probability Theory I , 1977 .

[22]  THE LADDER VARIABLES OF A MARKOV RANDOM WALK , 2008 .

[23]  Chang‐Jin Kim,et al.  Dynamic linear models with Markov-switching , 1994 .

[24]  James D. Hamilton,et al.  Autoregressive conditional heteroskedasticity and changes in regime , 1994 .

[25]  Limit theorems for iterated random functions by regenerative methods , 2001 .

[26]  P. Ney,et al.  Markov Additive Processes I. Eigenvalue Properties and Limit Theorems , 1987 .

[27]  A. A. Borovkov,et al.  STOCHASTICALLY RECURSIVE SEQUENCES AND THEIR GENERALIZATIONS , 1992 .

[28]  Yoshua Bengio,et al.  A Recurrent Latent Variable Model for Sequential Data , 2015, NIPS.

[29]  James D. Hamilton.  A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle , 1989 .

[30]  Yajun Mei,et al.  Quickest Change Detection and Kullback-Leibler Divergence for Two-State Hidden Markov Models , 2015, IEEE Trans. Signal Process..

[31]  Orjan Stenflo.  Iterated Function Systems Controlled by a Semi-Markov Chain , 1996 .

[32]  David Steinsaltz,et al.  Locally Contractive Iterated Function Systems , 1999 .

[33]  Geoffrey E. Hinton,et al.  Variational Learning for Switching State-Space Models , 2000, Neural Computation.

[34]  Heriot-Watt University.  AN OVERVIEW OF SOME STOCHASTIC STABILITY METHODS , 2004 .

[35]  C. C. Heyde.  Two Probability Theorems and Their Application to Some First Passage Problems , 1964 .

[36]  Thomas Kaijser.  A limit theorem for Markov chains in compact metric spaces with applications to products of random matrices , 1978 .

[37]  Cheng-Der Fuh,et al.  Asymptotic expansions in multidimensional Markov renewal theory and first passage times for Markov random walks , 2001, Advances in Applied Probability.

[38]  Sergey Foss,et al.  Stochastic stability of monotone economies in regenerative environments , 2018, J. Econ. Theory.

[39]  Cheng-Der Fuh,et al.  SPRT and CUSUM in hidden Markov models , 2003 .

[40]  Deli Li,et al.  Asymptotic behavior for iterated functions of random variables , 1999 .

[41]  J. Elton.  A multiplicative ergodic theorem for lipschitz maps , 1990 .

[42]  M. Barnsley,et al.  Iterated function systems and the global construction of fractals , 1985, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[43]  W. Wu,et al.  Nonlinear system theory: another look at dependence. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[44]  On the Nonuniqueness of the Invariant Probability for I.I.D. Random Logisitc Maps , 2002 .

[45]  M. Barnsley,et al.  Recurrent iterated function systems , 1989 .

[46]  M. Barnsley,et al.  A new class of markov processes for image encoding , 1988, Advances in Applied Probability.

[47]  A Contractivity Condition for Iterated Function Systems , 2002 .

[48]  J. L. Jensen.  Asymptotic exapnsions for strongly mixing Harris recurrent Markov chains , 1989 .