Computer-assisted analysis of mixtures (C.A.MAN) statistical algorithms

SUMMARY This paper presents various algorithmic approaches for computing the maximum likelihood estimator of the mixing distribution of a one-parameter family of densities and provides a unifying computeroriented concept for the statistical analysis of unobserved heterogeneity (i.e., observations stemming from different subpopulations) in a univariate sample. The case with unknown number of population subgroups as well as the case with known number of population subgroups, with emphasis on the first, is considered in the computer package C.A.MAN (Computer Assisted Mixture ANalysis). It includes an algorithmic menu with choices of the EM algorithm, the vertex exchange algorithm, a combination of both, as well as the vertex direction method. To ensure reliable convergence, a steplength menu is provided for the three latter methods, each achieving monotonicity for the direction of choice. C.A.MAN has the option to work with restricted support size-that is, the case when the number of components is known a priori. In the latter case, the EM algorithm is used. Applications of mixture modelling in medical problems are discussed.

[1]  J. Kalbfleisch,et al.  An Algorithm for Computing the Nonparametric MLE of a Mixing Distribution , 1992 .

[2]  D. Böhning,et al.  Relationship of the morbidity of under-fives to anthropometric measurements and community health intervention. , 1990, Tropical medicine and parasitology : official organ of Deutsche Tropenmedizinische Gesellschaft and of Deutsche Gesellschaft fur Technische Zusammenarbeit.

[3]  R. DerSimonian.  Correction to Algorithm as 221: Maximum Likelihood Estimation of a Mixing Distribution , 1990 .

[4]  A. Hamerle.  On a Simple Test for Neglected Heterogeneity in Panel Studies , 1990 .

[5]  Alan E. Gelfand,et al.  A Note on Overdispersed Exponential Families , 1990 .

[6]  D. Böhning.  Likelihood inference for mixtures: Geometrical and other constructions of monotone step-length algorithms , 1989 .

[7]  D. Bates,et al.  Newton-Raphson and EM Algorithms for Linear Mixed-Effects Models for Repeated-Measures Data , 1988 .

[8]  B. Lindsay,et al.  Monotonicity of quadratic-approximation algorithms , 1988 .

[9]  D. Böhning,et al.  A fortran subroutine for computing indicators of the nutritional status of children and adolescents , 1986 .

[10]  R. Dersimonian.  Maximum Likelihood Estimation of a Mixing Distribution , 1986 .

[11]  A. F. Smith,et al.  Statistical analysis of finite mixture distributions , 1986 .

[12]  B. Lindsay.  Exponential family mixture models (with least-squares estimators) , 1986 .

[13]  P. D. M. Macdonald.  MIX: An Interactive Program for Fitting Mixtures of Distributions , 1986 .

[14]  L. Shepp,et al.  A Statistical Model for Positron Emission Tomography , 1985 .

[15]  Dankmar Böhning,et al.  Numerical estimation of a probability measure , 1985 .

[16]  M. Agha,et al.  Maximum Likelihood Estimation of Mixtures of Distributions , 1984 .

[17]  L. Fahrmeir,et al.  Multivariate statistische Verfahren , 1984 .

[18]  Russell C. H. Cheng,et al.  Estimating Parameters in Continuous Univariate Distributions with a Shifted Origin , 1983 .

[19]  David R. Cox,et al.  Some remarks on overdispersion , 1983 .

[20]  B. Lindsay.  The Geometry of Mixture Likelihoods: A General Theory , 1983 .

[21]  R C Grimson,et al.  Clustering of rare events. , 1983, Biometrics.

[22]  B. Everitt,et al.  Finite Mixture Distributions , 1981 .

[23]  Bruce G. Lindsay,et al.  Properties of the Maximum Likelihood Estimator of a Mixing Distribution , 1981 .

[24]  Moshe Shared,et al.  On Mixtures from Exponential Families , 1980 .

[25]  J. B. Ramsey,et al.  Estimating Mixtures of Normal Distributions and Switching Regressions , 1978 .

[26]  N. Laird.  Nonparametric Maximum Likelihood Estimation of a Mixing Distribution , 1978 .

[27]  F. Jones,et al.  International Classification of Diseases , 1978 .

[28]  Changbao Wu,et al.  Some Algorithmic Aspects of the Theory of Optimal Designs , 1978 .

[29]  K. Kortanek,et al.  Equivalence Theorems and Cutting Plane Algorithms for a Class of Experimental Design Problems , 1977 .

[30]  J M Tanner,et al.  The presentation and use of height and weight data for comparing the nutritional status of groups of children under the age of 10 years. , 1977, Bulletin of the World Health Organization.

[31]  Corwin L. Atwood,et al.  Convergent Design Sequences, for Sufficiently Regular Optimality Criteria , 1976 .

[32]  D. Hosmer.  A Comparison of Iterative Maximum Likelihood Estimates of the Parameters of a Mixture of Two Normal Distributions Under Three Different Types of Sample , 1973 .

[33]  P. Whittle.  Some General Points in the Theory of Optimal Experimental Design , 1973 .

[34]  S. Silvey,et al.  A geometric approach to optimal design theory , 1973 .

[35]  W. J. Studden,et al.  Theory Of Optimal Experiments , 1972 .

[36]  N. E. Day.  Estimating the components of a mixture of normal distributions , 1969 .

[37]  V. Hasselblad.  Finite mixtures of distributions from the exponential family , 1969 .

[38]  J. Kiefer,et al.  The Equivalence of Two Extremum Problems , 1960, Canadian Journal of Mathematics.

[39]  J. Kiefer,et al.  CONSISTENCY OF THE MAXIMUM LIKELIHOOD ESTIMATOR IN THE PRESENCE OF INFINITELY MANY INCIDENTAL PARAMETERS , 1956 .

[40]  Walter Schilling,et al.  A Frequency Distribution Represented as the Sum of Two Poisson Distributions , 1947 .