Non parametric mixture priors based on an exponential random scheme

We propose a general procedure for constructing nonparametric priors for Bayesian inference. Under very general assumptions, the proposed prior selects absolutely continuous distribution functions, hence it can be useful with continuous data. We use the notion ofFeller-type approximation, with a random scheme based on the natural exponential family, in order to construct a large class of distribution functions. We show how one can assign a probability to such a class and discuss the main properties of the proposed prior, namedFeller prior. Feller priors are related to mixture models with unknown number of components or, more generally, to mixtures with unknown weight distribution. Two illustrations relative to the estimation of a density and of a mixing distribution are carried out with respect to well known data-set in order to evaluate the performance of our procedure. Computations are performed using a modified version of an MCMC algorithm which is briefly described.

[1]  W. J. Hall,et al.  Approximating Priors by Mixtures of Natural Conjugate Priors , 1983 .

[2]  L. Wasserman,et al.  Consistency of Bernstein polynomial posteriors , 2002 .

[3]  T. Ferguson BAYESIAN DENSITY ESTIMATION BY MIXTURES OF NORMAL DISTRIBUTIONS , 1983 .

[4]  L. Tardella,et al.  Approximating distributions of random functionals of Ferguson‐Dirichlet priors , 1998 .

[5]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[6]  E. George Combining Minimax Shrinkage Estimators , 1986 .

[7]  W. Feller,et al.  An Introduction to Probability Theory and Its Applications, Vol. II , 1972, The Mathematical Gazette.

[8]  J. Sethuraman A CONSTRUCTIVE DEFINITION OF DIRICHLET PRIORS , 1991 .

[9]  J. Ghosh,et al.  POSTERIOR CONSISTENCY OF DIRICHLET MIXTURES IN DENSITY ESTIMATION , 1999 .

[10]  Albert Y. Lo,et al.  On a Class of Bayesian Nonparametric Estimates: I. Density Estimates , 1984 .

[11]  P. Billingsley,et al.  Convergence of Probability Measures , 1969 .

[12]  K. Roeder Density estimation with confidence sets exemplified by superclusters and voids in the galaxies , 1990 .

[13]  Prakasa Rao Nonparametric functional estimation , 1983 .

[14]  C. Antoniak Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems , 1974 .

[15]  Sonia Petrone Random Bernstein Polynomials , 1999 .

[16]  H. Ishwaran,et al.  Markov chain Monte Carlo in approximate Dirichlet and beta two-parameter process hierarchical models , 2000 .

[17]  Francesco Altomare,et al.  Korovkin-type approximation theory and its applications , 1994 .

[18]  M. Escobar,et al.  Bayesian Density Estimation and Inference Using Mixtures , 1995 .

[19]  Axel Tenbusch,et al.  Nonparametric curve estimation with bernstein estimates , 1997 .

[20]  Guido Consonni,et al.  A Bayesian Method for Combining Results from Several Binomial Experiments , 1995 .