An inverse Sanov theorem for curved exponential families∗

We prove the large deviation principle (LDP) for posterior distributions arising from curved exponential families in a parametric setting, allowing misspecification of the model. Moreover, motivated by the so called inverse Sanov Theorem, obtained in a nonparametric setting by Ganesh and O’Connell (1999 and 2000), we study the relationship between the rate function for the LDP studied in this paper, and the one for the LDP for the corresponding maximum likelihood estimators. In our setting, even in the non misspecified case, it is not true in general that the rate functions for posterior distributions and for maximum likelihood estimators are Kullback-Leibler divergences with exchanged arguments. Finally, the results of the paper has some further interest for the case of exponential families with a dual one (see Letac (2021+)).

[1]  Ayalvadi Ganesh,et al.  An inverse of Sanov's theorem , 1999 .

[2]  I. M. Chakravarti,et al.  Asymptotic Theory of Statistical Tests and Estimation: In Honor of Wassily Hoeffding , 1980 .

[3]  C. Macci Extension of some large deviation results for posterior distributions , 2014 .

[4]  Gary Simon,et al.  Additivity of Information in Exponential Family Probability Laws , 1973 .

[5]  A. Ganesh,et al.  A large-deviation principle for Dirichlet posteriors , 2000 .

[6]  A. Kester,et al.  Large Deviations of Estimators , 1986 .

[7]  M. A. Arcones,et al.  Large deviations for M-estimators , 2006 .

[8]  E. Beckenbach CONVEX FUNCTIONS , 2007 .

[9]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[10]  Larry Wasserman,et al.  Asymptotic Properties of Nonparametric Bayesian Procedures , 1998 .

[11]  Morris L. Eaton,et al.  On extreme stable laws and some applications , 1971, Journal of Applied Probability.

[12]  L. Brown Fundamentals of statistical exponential families: with applications in statistical decision theory , 1986 .

[13]  Censored Exponential Data: Large Deviations for MLEs and Posterior Distributions , 2009 .

[14]  G'erard Letac,et al.  Duality for real and multivariate exponential families , 2021, J. Multivar. Anal..

[15]  A. V. D. Vaart,et al.  Misspecification in infinite-dimensional Bayesian statistics , 2006, math/0607023.

[16]  D. Ter Haar,et al.  Collected Papers of L. D. Landau , 1965 .

[17]  O. Barndorff-Nielsen Information and Exponential Families in Statistical Theory , 1980 .