AN ASYMPTOTIC ANALYSIS OF A CLASS OF DISCRETE NONPARAMETRIC PRIORS

In this paper we analyze the asymptotic behaviour of Gibbs-type priors, that represent a natural generalization of the Dirichlet process. After determining their topological support, we investigate their consistency according to the "what if", or frequentist, approach, that postulates the existence of a "true" distribution P 0 . We provide a full taxonomy of their limiting behaviours: consistency holds essentially always for discreteP 0 , whereas inconsistency may occur for diffuseP 0 . Such findings are further illustrated by means of three special cases admitting closed form expressions and exhibiting a wide range of asymptotic behaviours. For both Gibbs-type priors and discrete nonparametric priors in general, the possible inconsistency should not be interpreted as evidence against their usetout court. It rather represents an indication that they are designed for modeling discrete distributions and evidence against their use in the case of diffuseP 0 .

[1]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[2]  J. Fabius.  Asymptotic behavior of bayes' estimates , 1963 .

[3]  D. Freedman.  On the Asymptotic Behavior of Bayes' Estimates in the Discrete Case , 1963 .

[4]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[5]  T. Ferguson.  A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[6]  T. Ferguson.  Prior Distributions on Spaces of Probability Measures , 1974 .

[7]  G. Pólya,et al.  Problems and Theorems in Analysis I: Series. Integral Calculus. Theory of Functions , 1976 .

[8]  S. Zabell.  W. E. Johnson's "Sufficientness" Postulate , 1982 .

[9]  D. Freedman,et al.  ON INCONSISTENT BAYES ESTIMATES IN THE DISCRETE CASE , 1983 .

[10]  G. Pólya,et al.  Problems and theorems in analysis , 1983 .

[11]  D. Freedman,et al.  On the consistency of Bayes estimates , 1986 .

[12]  On topological support of Dirichlet prior , 1992 .

[13]  M. Lavine.  More Aspects of Polya Tree Distributions for Statistical Modelling , 1992 .

[14]  G. Pólya,et al.  Series, integral calculus, theory of functions , 1998 .

[15]  J. Ghosh,et al.  POSTERIOR CONSISTENCY OF DIRICHLET MIXTURES IN DENSITY ESTIMATION , 1999 .

[16]  Lancelot F. James,et al.  Gibbs Sampling Methods for Stick-Breaking Priors , 2001 .

[17]  F. Quintana,et al.  Bayesian clustering and product partition models , 2003 .

[18]  Lancelot F. James,et al.  Generalized weighted Chinese restaurant processes for species sampling mixture models , 2003 .

[19]  J. Pitman,et al.  Exchangeable Gibbs partitions and Stirling triangles , 2004, math/0412494.

[20]  T. Ferguson.  Some Developments of the Blackwell-MacQueen Urn Scheme , 2005 .

[21]  S. Walker,et al.  On Consistency of Nonparametric Normal Mixtures for Bayesian Density Estimation , 2005 .

[22]  Yee Whye Teh,et al.  A Hierarchical Bayesian Language Model Based On Pitman-Yor Processes , 2006, ACL.

[23]  J. Pitman.  Combinatorial Stochastic Processes , 2006 .

[24]  Lancelot F. James,et al.  Conjugacy as a Distinctive Feature of the Dirichlet Process , 2006 .

[25]  Ramsés H. Mena,et al.  Controlling the reinforcement in Bayesian non‐parametric mixture models , 2007 .

[26]  Antonio Lijoi,et al.  A Bayesian nonparametric method for prediction in EST analysis , 2007, BMC Bioinformatics.

[27]  Ramsés H. Mena,et al.  Bayesian Nonparametric Estimation of the Probability of Discovering New Species , 2007 .

[28]  Michael I. Jordan,et al.  Hierarchical Bayesian Nonparametric Models with Applications , 2008 .

[29]  Lancelot F. James.  Large sample asymptotics for the two-parameter Poisson–Dirichlet process , 2007, 0708.4294.

[30]  Stephen G. Walker,et al.  On a Class of Random Probability Measures with General Predictive Structure , 2011 .

[31]  Fernando A. Quintana,et al.  Some issues in nonparametric Bayesian modeling using species sampling models , 2008 .

[32]  A. Gnedin.  A Species Sampling Model with Finitely Many Types , 2009, 0910.1988.

[33]  S. Ghosal,et al.  2 The Dirichlet process , related priors and posterior asymptotics , 2009 .

[34]  Gun Ho Jang,et al.  POSTERIOR CONSISTENCY OF SPECIES SAMPLING PRIORS , 2010 .

[35]  S. Ghosal.  Bayesian Nonparametrics: The Dirichlet process, related priors and posterior asymptotics , 2010 .

[36]  Michael I. Jordan,et al.  Bayesian Nonparametrics: Hierarchical Bayesian nonparametric models with applications , 2010 .

[37]  Fernando A. Quintana,et al.  On the Support of MacEachern’s Dependent Dirichlet Processes and Extensions , 2012 .

[38]  P. McCullagh.  Partition models , 2015 .

[39]  Matteo Ruggiero,et al.  Are Gibbs-Type Priors the Most Natural Generalization of the Dirichlet Process? , 2015, IEEE transactions on pattern analysis and machine intelligence.