Large Deviations Asymptotics and the Spectral Theory of Multiplicatively Regular Markov Processes

In this paper we continue the investigation of the spectral theory and exponential asymptotics of primarily discrete-time Markov processes, following Kontoyiannis and Meyn (2003). We introduce a new family of nonlinear Lyapunov drift criteria, which characterize distinct subclasses of geometrically ergodic Markov processes in terms of simple inequalities for the nonlinear generator. We concentrate primarily on the class of multiplicatively regular Markov processes, which are characterized via simple conditions similar to (but weaker than) those of Donsker-Varadhan. For any such process $\{\Phi(t)\}$ with transition kernel $P$ on a general state space $X$, the following are obtained. Spectral Theory: For a large class of (possibly unbounded) functionals $F$ on $X$, the kernel $\hat P(x,dy) = e^{F(x)} P(x,dy)$ has a discrete spectrum in an appropriately defined Banach space. It follows that there exists a "maximal," well-behaved solution to the "multiplicative Poisson equation," defined as an eigenvalue problem for $\hat P$. Multiplicative Mean Ergodic Theorem: Consider the partial sums of this process with respect to any one of the functionals $F$ considered above. The normalized mean of their moment generating function (and not the logarithm of the mean) converges to the above maximal eigenfunction exponentially fast. Multiplicative regularity: The Lyapunov drift criterion under which our results are derived is equivalent to the existence of regeneration times with finite exponential moments for the above partial sums. Large Deviations: The sequence of empirical measures of the process satisfies a large deviations principle in a topology finer that the usual tau-topology, generated by the above class of functionals. The rate function of this LDP is the convex dual of logarithm of the above maximal eigenvalue, and it is shown to coincide with the Donsker-Varadhan rate function in terms of relative entropy. Exact Large Deviations Asymptotics: The above partial sums are shown to satisfy an exact large deviations expansion, analogous to that obtained by Bahadur and Ranga Rao for independent random variables.

[1]  R. R. Bahadur,et al.  On Deviations of the Sample Mean , 1960 .

[2]  H. D. Miller A Convexity Property in the Theory of Random Variables Defined on a Finite Markov Chain , 1961 .

[3]  E. Çinlar Markov additive processes. I , 1972 .

[4]  E. Çinlar Markov additive processes. II , 1972 .

[5]  S. Varadhan,et al.  Asymptotic evaluation of certain Markov process expectations for large time , 1975 .

[6]  W. Fleming Exit probabilities and optimal stochastic control , 1977 .

[7]  Piet Groeneboom,et al.  Large Deviation Theorems for Empirical Probability Measures , 1979 .

[8]  P. Ney,et al.  Large deviations of uniformly recurrent Markov additive processes , 1985 .

[9]  N. Kartashov Inequalities in Theorems of Ergodicity and Stability for Markov Chains with Common Phase Space. I , 1986 .

[10]  P. Ney,et al.  MARKOV ADDITIVE PROCESSES II. LARGE DEVIATIONS , 1987 .

[11]  J. Gärtner,et al.  Large deviations from the mckean-vlasov limit for weakly interacting diffusions , 1987 .

[12]  E. Bolthausen Markov process large deviations in τ-topology , 1987 .

[13]  P. Ney,et al.  Markov Additive Processes I. Eigenvalue Properties and Limit Theorems , 1987 .

[14]  国田 寛 Stochastic flows and stochastic differential equations , 1990 .

[15]  N. Jain,et al.  Large Deviation Lower Bounds for Additive Functionals of Markov Processes , 1990 .

[16]  Mtw,et al.  Stochastic flows and stochastic differential equations , 1990 .

[17]  A. Acosta Large deviations for empirical measures of Markov chains , 1990 .

[18]  Richard F. Bass,et al.  Some Potential Theory for Reflecting Brownian Motion in Holder and Lipschitz Domains , 1991 .

[19]  Saddlepoint expansions for sums of Markov dependent variables on a continuous state space , 1991 .

[20]  A. Hordijk,et al.  On ergodicity and recurrence properties of a Markov chain by an application to an open jackson network , 1992, Advances in Applied Probability.

[21]  Sean P. Meyn,et al.  Generalized Resolvents and Harris Recurrence of Markov Processes , 1992 .

[22]  S. Meyn,et al.  Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes , 1993, Advances in Applied Probability.

[23]  N. R. Chaganty,et al.  Strong Large Deviation and Local Limit Theorems , 1993 .

[24]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[25]  S. Meyn,et al.  Computable Bounds for Geometric Convergence Rates of Markov Chains , 1994 .

[26]  S. Meyn,et al.  Exponential and Uniform Ergodicity of Markov Processes , 1995 .

[27]  R. Pinsky Positive Harmonic Functions and Diffusion: References , 1995 .

[28]  Paul Dupuis,et al.  A nonstandard form of the rate function for the occupation measure of a Markov chain , 1996 .

[29]  Sean P. Meyn,et al.  A Liapounov bound for solutions of the Poisson equation , 1996 .

[30]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[31]  Jin Feng Martingale problems for large deviations of Markov processes , 1999 .

[32]  O. Junge,et al.  On the Approximation of Complicated Dynamical Behavior , 1999 .

[33]  Luc Rey-Bellet,et al.  Asymptotic Behavior of Thermal Nonequilibrium Steady States for a Driven Chain of Anharmonic Oscillators , 2000, math-ph/0001016.

[34]  S. Meyn,et al.  Multiplicative ergodicity and large deviations for an irreducible Markov chain , 2000 .

[35]  A. Bovier,et al.  Metastability and small eigenvalues in Markov chains , 2000, cond-mat/0007343.

[36]  S. Balajiy,et al.  Multiplicative Ergodicity and Large Deviations for an Irreducible Markov Chain , 2000 .

[37]  E. Davies,et al.  Pseudospectra of differential operators , 2000 .

[38]  Liming Wu Large and moderate deviations and exponential convergence for stochastic damping Hamiltonian systems , 2001 .

[39]  U. Schmock,et al.  LARGE DEVIATIONS FOR PRODUCTS OF EMPIRICAL MEASURES OF DEPENDENT SEQUENCES , 2001 .

[40]  S. Meyn,et al.  Spectral theory and limit theorems for geometrically ergodic Markov processes , 2002, math/0209200.

[41]  L. Thomas,et al.  Fluctuations of the Entropy Production in Anharmonic Chains , 2001, math-ph/0110025.

[42]  S. Meyn,et al.  Phase transitions and metastability in Markovian and molecular systems , 2004 .

[43]  T. Kurtz,et al.  Large Deviations for Stochastic Processes , 2006 .

[44]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.