Rates of convergence for the posterior distributions of mixtures of betas and adaptive nonparamatric estimation of the density

In this work we investigate the asymptotic properties of nonparametric bayesian mixtures of Betas for estimating a smooth density on [0,1]. We consider a parameterisation of Betas distributions in terms of mean and scale parameters and construct a mixture of these Betas in the mean parameter, while putting a prior on this scaling parameter. We prove that such Bayesian nonparametric models have good frequentist asymptotic properties. We determine the posterior rate of concentration around the true density and prove that it is the minimax rate of concentration when the true density belongs to a Holder class with regularity β, for all positive β, leading to a minimax adaptive estimating procedure of the density. We show that Bayesian kernel estimation is more flexible than the usual frequentist kernel estimation allowing for adaptive rates of convergence, using a simple trick which can be used in many other types of kernel Bayesian approaches.

[1]  D. Owen Handbook of Mathematical Functions with Formulas , 1965 .

[2]  M. Abramowitz,et al.  Handbook of Mathematical Functions With Formulas, Graphs and Mathematical Tables (National Bureau of Standards Applied Mathematics Series No. 55) , 1965 .

[3]  T. Ferguson BAYESIAN DENSITY ESTIMATION BY MIXTURES OF NORMAL DISTRIBUTIONS , 1983 .

[4]  M. Abramowitz,et al.  Handbook of Mathematical Functions With Formulas, Graphs and Mathematical Tables (National Bureau of Standards Applied Mathematics Series No. 55) , 1965 .

[5]  A. V. D. Vaart,et al.  Convergence rates of posterior distributions , 2000 .

[6]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[7]  S. Ghosal Convergence rates for density estimation with Bernstein polynomials , 2001 .

[8]  A. V. D. Vaart,et al.  Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities , 2001 .

[9]  Convergence rates of posterior distributions for dirichlet mixtures of normal densities. , 2001 .

[10]  Michael,et al.  On a Class of Bayesian Nonparametric Estimates : I . Density Estimates , 2008 .

[11]  Sonia Petrone,et al.  Non parametric mixture priors based on an exponential random scheme , 2002 .

[12]  W. Kruijer Convergence Rates in Nonparametric Bayesian Density Estimation , 2004 .

[13]  Jean-Michel Marin,et al.  Bayesian Modelling and Inference on Mixtures of Distributions , 2005 .

[14]  Judith Rousseau,et al.  Approximating Interval hypothesis : p-values and Bayes factors , 2007 .

[15]  A. V. D. Vaart,et al.  Bayesian inference with rescaled Gaussian process priors , 2007, 0710.3679.

[16]  A. V. D. Vaart,et al.  Posterior convergence rates of Dirichlet mixtures at smooth densities , 2007, 0708.1885.

[17]  A. V. D. Vaart,et al.  Posterior convergence rates for Dirichlet mixtures of beta densities , 2008 .

[18]  S. Ghosal,et al.  Kullback Leibler property of kernel mixture priors in Bayesian density estimation , 2007, 0710.2746.

[19]  Van Der Vaart,et al.  Adaptive Bayesian estimation using a Gaussian random field with inverse Gamma bandwidth , 2009, 0908.3556.

[20]  Judith Rousseau,et al.  Bayesian Goodness of Fit Testing with Mixtures of Triangular Distributions , 2009 .