Limit theorems for monotone Markov processes

This article considers the convergence to steady states of Markov processes generated by the action of successive i.i.d. monotone maps on a subset S of an Eucledian space. Without requiring irreducibility or Harris recurrence, a “splitting” condition guarantees the existence of a unique invariant probability as well as an exponential rate of convergence to it in an appropriate metric. For a special class of Harris recurrent processes on [0,∞) of interest in economics, environmental studies and queuing theory, criteria are derived for polynomial and exponential rates of convergence to equilibrium in total variation distance. Central limit theorems follow as consequences.

[1]  Tapan Mitra,et al.  Dynamic optimization under uncertainty: non-convex feasible set , 1989 .

[2]  T. Lindvall.  Lectures on the Coupling Method , 1992 .

[3]  G. R. Feiwel.  Joan Robinson and Modern Economic Theory , 1989 .

[4]  F. Spitzer.  A Combinatorial Lemma and its Application to Probability Theory , 1956 .

[5]  R. Bhattacharya,et al.  Random iterates of monotone maps , 2010 .

[6]  D. Blackwell.  Discounted Dynamic Programming , 1965 .

[7]  P. A. P. Moran,et al.  An introduction to probability theory , 1968 .

[8]  Rabi Bhattacharya,et al.  On a Class of Stable Random Dynamical Systems: Theory and Applications , 2001, J. Econ. Theory.

[9]  R. Rao,et al.  Normal Approximation and Asymptotic Expansions , 1976 .

[10]  D. Freedman,et al.  Invariant Probabilities for Certain Markov Processes , 1966 .

[11]  William Feller,et al.  An Introduction to Probability Theory and Its Applications, Vol. 2 , 1967 .

[12]  P. Billingsley,et al.  Convergence of Probability Measures , 1969 .

[13]  Richard L. Tweedie,et al.  Geometric Convergence Rates for Stochastically Ordered Markov Chains , 1996, Math. Oper. Res..

[14]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[15]  Stochastic equilibrium: Concepts and computations for Lindley processes , 2010 .

[16]  E. Prescott,et al.  Stochastic Monotonicity and Stationary Distributions for Dynamic Economies , 1992 .

[17]  Stephen P. Ellner,et al.  Asymptotic behavior of some stochastic difference equation population models , 1984 .

[18]  Y. Kifer.  Ergodic theory of random transformations , 1986 .

[19]  Robert M. Blumenthal,et al.  On continuous collections of measures , 1970 .

[20]  R. Bhattacharya.  On the functional central limit theorem and the law of the iterated logarithm for Markov processes , 1982 .

[21]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[22]  Rabi Bhattacharya,et al.  Stochastic processes with applications , 1990 .

[23]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[24]  Persi Diaconis,et al.  Iterated Random Functions , 1999, SIAM Rev..

[25]  Completeness of Bhattacharya metric on the space of probabilities , 1998 .

[26]  ON A FIXED POINT THEOREM AND ITS STOCHASTIC EQUIVALENT , 1975 .

[27]  R. Bhattacharya,et al.  On a Theorem of Dubins and Freedman , 1999 .

[28]  Tapan Mitra,et al.  Dynamic Optimization with a Non-Convex Technology: The Case of a Linear Objective Function , 1983 .

[29]  Rabi Bhattacharya,et al.  Random Dynamical Systems: Theory and Applications , 2007 .

[30]  Rabi Bhattacharya,et al.  Random Dynamical Systems: Acknowledgment , 2007 .

[31]  Stamatis Cambanis,et al.  Stochastic processes : a Festschrift in honour of Gopinath Kallianpur , 1993 .

[32]  H. L. Le Roy,et al.  Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IV , 1969 .

[33]  R. Bhattacharya,et al.  ASYMPTOTICS OF A CLASS OF MARKOV PROCESSES WHICH ARE NOT IN GENERAL IRREDUCIBLE , 1988 .

[34]  Random Iterations of Two Quadratic Maps , 1993 .

[35]  D. V. Lindley,et al.  The theory of queues with a single server , 1952, Mathematical Proceedings of the Cambridge Philosophical Society.

[36]  R. Bhattacharya,et al.  Stability in distribution of randomly perturbed quadratic maps as Markov processes , 2004, math/0503540.