Distributional properties of means of random probability measures

The present paper provides a review of the results concerning distributional properties of means of random probability measures. Our interest in this topic has originated from inferential problems in Bayesian Nonparametrics. Nonetheless, it is worth noting that these random quantities play an important role in seemingly unrelated areas of research. In fact, there is a wealth of contributions both in the statistics and in the probability literature that we try to summarize in a unified framework. Particular attention is devoted to means of the Dirichlet process given the relevance of the Dirichlet process in Bayesian Nonparametrics. We then present a number of recent contributions concerning means of more general random probability measures and highlight connections with the moment problem, combinatorics, special functions, excursions of stochastic processes and statistical physics.

[1]  S. Kerov,et al.  The Markov–Krein Correspondence in Several Dimensions , 2004 .

[2]  Lancelot F. James,et al.  Posterior Analysis for Normalized Random Measures with Independent Increments , 2009 .

[3]  Albert Y. Lo,et al.  On a class of Bayesian nonparametric estimates: II. Hazard rate estimates , 1989 .

[4]  J. Pitman.  Exchangeable and partially exchangeable random partitions , 1995 .

[5]  Kouji Yano,et al.  Remarks on the density of the law of the occupation time for Bessel bridges and stable excursions , 2007, 0706.3162.

[6]  Ramsés H. Mena,et al.  Controlling the reinforcement in Bayesian non‐parametric mixture models , 2007 .

[7]  L. Tardella,et al.  Approximating distributions of random functionals of Ferguson‐Dirichlet priors , 1998 .

[8]  E. Regazzini,et al.  Distribution Functions of Means of a Dirichlet Process , 1990 .

[9]  J. Kingman,et al.  Completely random measures. , 1967 .

[10]  G. Peccati.  Multiple integral representation for functionals of Dirichlet processes , 2008, 0803.1029.

[11]  R. Tweedie,et al.  Printed in Great Britain Linear functionals and Markov chains associated with Dirichlet processes , 1988 .

[12]  Stephen G. Walker,et al.  Perfect Simulation Involving Functionals of a Dirichlet Process , 2002 .

[13]  N. Hjort,et al.  Exact Inference for Random Dirichlet Means , 2005 .

[14]  E. Regazzini,et al.  Theory and numerical analysis for exact distributions of functionals of a Dirichlet process , 2002 .

[15]  J. Kingman.  Random Discrete Distributions , 1975 .

[16]  T. Ferguson.  Some Developments of the Blackwell-MacQueen Urn Scheme , 2005 .

[17]  Albert Y. Lo,et al.  On a Class of Bayesian Nonparametric Estimates: I. Density Estimates , 1984 .

[18]  R. Stanley.  Enumerative Combinatorics: Volume 1 , 2011 .

[19]  Marc Yor,et al.  Generalized Gamma Convolutions, Dirichlet means, Thorin measures, with explicit examples , 2007, 0708.3932.

[20]  Lancelot F. James,et al.  Poisson Process Partition Calculus with Applications to Exchangeable Models and Bayesian Nonparametrics , 2002 .

[21]  Torkel Erhardsson.  Non‐parametric Bayesian Inference for Integrals with respect to an Unknown Finite Measure , 2008 .

[22]  Harold Exton,et al.  Multiple hypergeometric functions and applications , 1979 .

[23]  Eugenio Melilli,et al.  Some new results for dirichlet priors , 2000 .

[24]  Lancelot F. James.  Functionals of dirichlet processes, the cifarelli-regazzini identity and beta-gamma processes , 2005, math/0505606.

[25]  A. Lijoi,et al.  Distributional results for means of normalized random measures with independent increments , 2003 .

[26]  J. Doob.  Stochastic processes , 1953 .

[27]  Purushottam W. Laud,et al.  A Bayesian Nonparametric Approach to Reliability , 1981 .

[28]  Lancelot F. James,et al.  Distributions of linear functionals of two parameter Poisson-Dirichlet random measures. , 2006, math/0609488.

[29]  Donato Michele Cifarelli,et al.  A general approach to Bayesian analysis of nonparametric problems: The associative mean values within the framework of the Dirichlet process , 1979 .

[30]  A. Brix.  Generalized Gamma measures and shot-noise Cox processes , 1999, Advances in Applied Probability.

[31]  T. Ferguson.  A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[32]  Daryl J. Daley,et al.  An Introduction to the Theory of Point Processes , 2013 .

[33]  Jim Pitman,et al.  Arcsine Laws and Interval Partitions Derived from a Stable Subordinator , 1992 .

[34]  P. Levy.  Sur certains processus stochastiques homogènes , 1940 .

[35]  J. Gurland.  Inversion Formulae for the Distribution of Ratios , 1948 .

[36]  A simple procedure calculating the generalized Stieltjes transform of the mean of a Dirichlet process , 1998 .

[37]  A. Guglielmi,et al.  A stochastic equation for the law of the random Dirichlet variance , 2006 .

[38]  D. Sumner.  An inversion formula for the generalized Stieltjes transform , 1949 .

[39]  R. Stanley.  What Is Enumerative Combinatorics , 1986 .

[40]  Hajime Yamato.  Characteristic Functions of Means of Distributions Chosen from a Dirichlet Process , 1984 .

[41]  N. Hjort.  Topics in Nonparametric Bayesian Statistics , 2003 .

[42]  Means of a Dirichlet process and multiple hypergeometric functions , 2004, math/0410151.

[43]  ON BEHAVIORS OF MEANS OF DISTRIBUTIONS WITH DIRICHLET PROCESSES , 1980 .

[44]  Thomas J. Jiang,et al.  Filtered-Variate Prior Distributions for Histogram Smoothing , 1998 .

[45]  Ilenia Epifani,et al.  Exponential functionals and means of neutral-to-the-right priors Biometrika 90 , 2003 .

[46]  S. Walker,et al.  Normalized random measures driven by increasing additive processes , 2004, math/0508592.

[47]  D. Blackwell.  Discreteness of Ferguson Selections , 1973 .

[48]  N. Hjort,et al.  NONPARAMETRIC QUANTILE INFERENCE USING DIRICHLET PROCESSES , 2006 .

[49]  G. Constantine,et al.  A Multivariate Faa di Bruno Formula with Applications , 1996 .

[50]  Grigori Olshanski,et al.  Kirillov's Seminar on Representation Theory , 1997 .

[51]  The generalized Stieltjes transform and its inverse , 2004, math-ph/0405050.

[52]  O. Pulkkinen.  Boundary Driven Zero-Range Processes in Random Media , 2007, 0707.0195.

[53]  Matthew A. Carlton.  A family of densities derived from the three-parameter Dirichlet process , 2002, Journal of Applied Probability.

[54]  M. Yor,et al.  Exponential functionals of Levy processes , 2005, math/0511265.

[55]  R. Tweedie,et al.  Markov chain Monte Carlo estimation of the law of the mean of a Dirichlet process , 2001 .

[56]  Jim Pitman,et al.  On the relative lengths of excursions derived from a stable subordinator , 1997 .

[57]  Jim Pitman,et al.  Une extension multidimensionnelle de la loi de l'arc sinus , 1989 .

[58]  M. R. Leadbetter.  Poisson Processes , 2011, International Encyclopedia of Statistical Science.

[59]  Lancelot F. James,et al.  On the posterior distribution of classes of random means , 2010, 1002.4276.

[60]  J. Pitman,et al.  Continuum tree asymptotics of discrete fragmentations and applications to phylogenetic models , 2006, math/0604350.

[61]  F. Spitzer.  Interaction of Markov processes , 1970 .

[62]  Robert C. Hannum,et al.  Distributional Results for Random Functionals of a Dirichlet Process , 1981 .

[63]  M. Yor,et al.  On the Markov–Krein Identity and Quasi-Invariance of the Gamma Process , 2004 .

[64]  T. Hill,et al.  Constructions of Random Distributions via Sequential Barycenters , 1998 .

[65]  T. Ferguson.  Prior Distributions on Spaces of Probability Measures , 1974 .

[66]  Dan Romik.  Explicit formulas for hook walks on continual Young diagrams , 2004, Adv. Appl. Math..

[67]  Mourad E. H. Ismail,et al.  Special Functions, Stieltjes Transforms and Infinite Divisibility , 1979 .

[68]  S. Walker,et al.  Beta-Stacy processes and a generalization of the Polya urn scheme , 1997 .

[69]  Dan Romik.  Roots of the Derivative of a Polynomial , 2005, Am. Math. Mon..

[70]  K. Doksum.  Tailfree and Neutral Random Probabilities and Their Posterior Distributions , 1974 .

[71]  H. Tamura.  Estimation of rare errors using expert judgement , 1988 .

[72]  Michael,et al.  On a Class of Bayesian Nonparametric Estimates : I . Density Estimates , 2008 .

[73]  Lancelot F. James,et al.  Conjugacy as a Distinctive Feature of the Dirichlet Process , 2006 .

[74]  M. Evans,et al.  Nonequilibrium statistical mechanics of the zero-range process and related models , 2005, cond-mat/0501338.

[75]  Hajime Yamato,et al.  EXPECTATIONS OF FUNCTIONS OF SAMPLES FROM DISTRIBUTIONS CHOSEN FROM DIRICHLET PROCESSES , 1984 .

[76]  J. Pitman.  Poisson-Kingman partitions , 2002, math/0210396.

[77]  Antonio Lijoi,et al.  Bayesian Nonparametric Analysis for a Generalized Dirichlet Process Prior , 2005 .

[78]  Ramsés H. Mena,et al.  Hierarchical Mixture Modeling With Normalized Inverse-Gaussian Priors , 2005 .

[79]  Lancelot F. James,et al.  Generalized weighted Chinese restaurant processes for species sampling mixture models , 2003 .

[80]  Lancelot F. James.  New Dirichlet mean identities , 2007, 0708.0614.

[81]  John Lamperti,et al.  An occupation time theorem for a class of stochastic processes , 1958 .