Bayesian density estimation using bernstein polynomials

We propose a Bayesian nonparametric procedure for density estimation, for data in a closed, bounded interval, say [0,1]. To this aim, we use a prior based on Bemstein polynomials. This corresponds to expressing the density of the data as a mixture of given beta densities, with random weights and a random number of components. The density estimate is then obtained as the corresponding predictive density function. Comparison with classical and Bayesian kernel estimates is provided. The proposed procedure is illustrated in an example; an MCMC algorithm for approximating the estimate is also discussed.

[1]  D. Blackwell,et al.  Ferguson Distributions Via Polya Urn Schemes , 1973 .

[2]  Tom Leonard,et al.  A Bayesian method for histograms , 1973 .

[3]  T. Ferguson.  A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[4]  D. Blackwell.  Discreteness of Ferguson Selections , 1973 .

[5]  Statistical inference and related topics , 1975 .

[6]  Richard A. Vitale,et al.  A Bernstein Polynomial Approach to Density Function Estimation , 1975 .

[7]  W. W. Daniel.  Applied Nonparametric Statistics , 1979 .

[8]  D. Berry,et al.  Empirical Bayes Estimation of a Binomial Parameter Via Mixtures of Dirichlet Processes , 1979 .

[9]  D. Freedman,et al.  On the histogram as a density estimator:L2 theory , 1981 .

[10]  T. Ferguson.  BAYESIAN DENSITY ESTIMATION BY MIXTURES OF NORMAL DISTRIBUTIONS , 1983 .

[11]  Albert Y. Lo,et al.  On a Class of Bayesian Nonparametric Estimates: I. Density Estimates , 1984 .

[12]  B. Silverman.  Density estimation for statistics and data analysis , 1986 .

[13]  D. Freedman,et al.  On the consistency of Bayes estimates , 1986 .

[14]  L. Kuo.  Computations of mixtures of dirichlet processes , 1986 .

[15]  Albert Y. Lo,et al.  Bayes Methods for a Symmetric Unimodal Density and its Mode , 1989 .

[16]  A. Bowman,et al.  A look at some data on the old faithful geyser , 1990 .

[17]  C. J. Stone,et al.  A study of logspline density estimation , 1991 .

[18]  W. Härdle.  Smoothing Techniques: With Implementation in S , 1991 .

[19]  David W. Scott,et al.  Multivariate Density Estimation: Theory, Practice, and Visualization , 1992, Wiley Series in Probability and Statistics.

[20]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[21]  W. Sudderth,et al.  Polya Trees and Random Distributions , 1992 .

[22]  J. Rosenthal.  Minorization Conditions and Convergence Rates for Markov Chain Monte Carlo , 1995 .

[23]  Axel Tenbusch,et al.  Two-dimensional Bernstein polynomial density estimators , 1994 .

[24]  Nils Lid Hjort,et al.  Bayesian Approaches to Non- and Semiparametric Density Estimation , 1994 .

[25]  M. Lavine.  More Aspects of Polya Tree Distributions for Statistical Modelling , 1992 .

[26]  M. Escobar.  Estimating Normal Means with a Dirichlet Process Prior , 1994 .

[27]  S. MacEachern.  Estimating normal means with a conjugate style dirichlet process prior , 1994 .

[28]  Cheng Cheng,et al.  The Bernstein polynomial estimator of a smooth quantile function , 1995 .

[29]  M. Escobar,et al.  Bayesian Density Estimation and Inference Using Mixtures , 1995 .

[30]  A. Gelfand,et al.  On nonparametric Bayesian inference for the distribution of a random sample , 1995 .

[31]  Polinomi di Bernstein e processo di Dirichlet , 1996 .

[32]  William N. Venables,et al.  Modern Applied Statistics with S-Plus. , 1996 .

[33]  J. Propp,et al.  Exact sampling with coupled Markov chains and applications to statistical mechanics , 1996 .

[34]  S. MacEachern,et al.  A semiparametric Bayesian model for randomised block designs , 1996 .

[35]  M. Gasparini.  Bayesian density estimation via dirichlet density processes , 1996 .

[36]  A. Raftery,et al.  A note on the Dirichlet process prior in Bayesian nonparametric inference with partial exchangeability , 1997 .

[37]  Axel Tenbusch,et al.  Nonparametric curve estimation with bernstein estimates , 1997 .

[38]  L. Wasserman,et al.  Bayesian goodness-of-fit testing using infinite-dimensional exponential families , 1998 .

[39]  Sonia Petrone.  Random Bernstein Polynomials , 1999 .