Likelihood and Bayesian analysis of mixtures

This paper compares likelihood and Bayesian analyses of finite mixture distributions, and expresses reservations about the latter. In particular, the role of prior assumptions in the full Monte Carlo Markov chain Bayes analysis is obscure, yet these assumptions clearly play a major role in the conclusions. These issues are illustrated with a detailed discussion of the well-known galaxy data.

[1]  J. Kiefer,et al.  CONSISTENCY OF THE MAXIMUM LIKELIHOOD ESTIMATOR IN THE PRESENCE OF INFINITELY MANY INCIDENTAL PARAMETERS , 1956 .

[2]  Marc Noe,et al.  The Calculation of Distributions of Two-Sided Kolmogorov-Smirnov Type Statistics , 1972 .

[3]  N. Laird.  Nonparametric Maximum Likelihood Estimation of a Mixing Distribution , 1978 .

[4]  Murray Aitkin,et al.  Statistical Modelling of Data on Teaching Styles , 1981 .

[5]  B. Lindsay.  The Geometry of Mixture Likelihoods, Part II: The Exponential Family , 1983 .

[6]  B. Lindsay.  The Geometry of Mixture Likelihoods: A General Theory , 1983 .

[7]  M. Postman,et al.  Probes of large-scale structure in the Corona Borealis region. , 1986 .

[8]  A. F. Smith,et al.  Statistical analysis of finite mixture distributions , 1986 .

[9]  G. McLachlan.  On Bootstrapping the Likelihood Ratio Test Statistic for the Number of Components in a Normal Mixture , 1987 .

[10]  K. Roeder.  Density estimation with confidence sets exemplified by superclusters and voids in the galaxies , 1990 .

[11]  Murray Aitkin,et al.  Fitting overdispersed generalized linear models by non-parametric maximum likelihood. , 1995 .

[12]  B. Carlin,et al.  Bayesian Model Choice Via Markov Chain Monte Carlo Methods , 1995 .

[13]  Art B. Owen,et al.  Nonparametric Likelihood Confidence Bands for a Distribution Function , 1995 .

[14]  Walter R. Gilks,et al.  Bayesian model comparison via jump diffusions , 1995 .

[15]  M. Escobar,et al.  Bayesian Density Estimation and Inference Using Mixtures , 1995 .

[16]  B. Lindsay.  Mixture models : theory, geometry, and applications , 1995 .

[17]  Murray Aitkin,et al.  A general maximum likelihood analysis of overdispersion in generalized linear models , 1996, Stat. Comput..

[18]  L. Wasserman,et al.  Practical Bayesian Density Estimation Using Mixtures of Normals , 1997 .

[19]  Sylvia Richardson,et al.  Markov Chain Monte Carlo in Practice , 1997 .

[20]  P. Green,et al.  On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion) , 1997 .

[21]  Dankmar Böhning,et al.  Computer-Assisted Analysis of Mixtures and Applications , 2000, Technometrics.

[22]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.