Long runs under a conditional limit distribution.

This paper presents a sharp approximation of the density of long runs of a random walk conditioned on its end value or by an average of a functions of its summands as their number tends to infinity. In the large deviation range of the conditioning event it extends the Gibbs conditional principle in the sense that it provides a description of the distribution of the random walk on long subsequences. Approximation of the density of the runs is also obtained when the conditioning event states that the end value of the random walk belongs to a thin or a thick set with non void interior. The approximations hold either in probability under the conditional distribution of the random walk, or in total variation norm between measures. Application of the approximation scheme to the evaluation of rare event probabilities through Importance Sampling is provided. When the conditioning event is in the zone of the central limit theorem it provides a tool for statistical inference in the sense that it produces an effective way to implement the Rao-Blackwell theorem for the improvement of estimators; it also leads to conditional inference procedures in models with nuisance parameters. An algorithm for the simulation of such long runs is presented, together with an algorithm determining the maximal length for which the approximation is valid up to a prescribed accuracy.

[1]  On the range of a constrained random walk , 1988 .

[2]  M. Broniatowski,et al.  Conditional Inference in Parametric Models , 2012, 1202.0944.

[3]  Robert L. Taylor,et al.  Limit theorems for sums of exchangeable random variables , 1987 .

[4]  O. Barndorff-Nielsen Information and Exponential Families in Statistical Theory , 1980 .

[5]  I. Csiszár Sanov Property, Generalized $I$-Projection and a Conditional Limit Theorem , 1984 .

[6]  Michel Broniatowski,et al.  Small Variance Estimators for Rare Event Probabilities , 2013, TOMC.

[7]  Bruno Tuffin,et al.  SOME RECENT RESULTS IN RARE EVENT ESTIMATION , 2014 .

[8]  Y. Ritov,et al.  Importance Sampling for rare events and conditioned random walks , 2009, 0910.1819.

[9]  D. Freedman,et al.  Conditional limit theorems for exponential families and finite versions of de Finetti's theorem , 1988 .

[10]  G. Weiss,et al.  A note on configurational properties of constrained random walks , 1988 .

[11]  Gérard Letac,et al.  Natural Real Exponential Families with Cubic Variance Functions , 1990 .

[12]  Local Limit Theorems for Large Deviations , 1957 .

[13]  Ole E. Barndorff-Nielsen,et al.  Information and Exponential Families in Statistical Theory , 1980 .

[14]  M. Broniatowski,et al.  On Sharp Large Deviations for Sums of Random Vectors and Multidimensional Laplace Approximation , 2005 .

[15]  D. Batkovich Local limit theorems for large deviations , 2013 .

[16]  Juan Carlos Abril,et al.  Saddlepoint Approximations , 2011, International Encyclopedia of Statistical Science.

[17]  Gerardo Rubino,et al.  Introduction to Rare Event Simulation , 2009, Rare Event Simulation using Monte Carlo Methods.

[18]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[19]  Flat and Multimodal Likelihoods and Model Lack of Fit in Curved Exponential Families , 2010 .

[20]  J. F. C. Kingman,et al.  Information and Exponential Families in Statistical Theory , 1980 .

[21]  Jan M. Van Campenhout,et al.  Maximum entropy and conditional probability , 1981, IEEE Trans. Inf. Theory.

[22]  Kent E. Morrison q-Exponential Families , 2004, Electron. J. Comb..

[23]  P. Dupuis,et al.  Importance Sampling, Large Deviations, and Differential Games , 2004 .

[24]  Amir Dembo,et al.  Refinements of the Gibbs conditioning principle , 1996 .

[25]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[26]  M. Broniatowski,et al.  Large-deviation probability and the local dimension of sets , 2000 .

[27]  M. Broniatowski,et al.  Towards zero variance estimators for rare event probabilities , 2011, 1104.1464.

[28]  Michel Broniatowski,et al.  Simulation in exponential families , 1999, TOMC.