Some new statistical methods for a class of zero-truncated discrete distributions with applications

Counting data without zero category often occurs in various fields. A class of zero-truncated discrete distributions such as the zero-truncated Poisson, zero-truncated binomial and zero-truncated negative-binomial distributions are proposed in literature to model such count data. In this paper, three main contributions have been made for better studying the zero-truncated discrete distributions: First, a novel unified expectation–maximization (EM) algorithm is developed for calculating the maximum likelihood estimates (MLEs) of parameters in general zero-truncated discrete distributions and an important feature of the proposed EM algorithm is that the latent variables and the observed variables are independent, which is unusual in general EM-type algorithms; Second, for those who do not understand the principle of latent variables, a unified minorization–maximization algorithm, as an alternative to the EM algorithm, for obtaining the MLEs of parameters in a class of zero-truncated discrete distributions is discussed; Third, a unified method is proposed to derive the distribution of the sum of i.i.d.zero-truncated discrete random variables, which has important applications in the construction of the shortest Clopper–Pearson confidence intervals of parameters of interest and in the calculation of the exact p value of a two-sided test for small sample sizes in one sample problem.

[1]  Jagbir Singh.  A Characterization of Positive Poisson Distribution and its Statistical Application , 1978 .

[2]  Shiferaw Gurmu,et al.  Tests for Detecting Overdispersion in the Positive Poisson Regression Model , 1991 .

[3]  R. L. Plackett,et al.  The Truncated Poisson Distribution , 1953 .

[4]  H. Hartley.  Maximum Likelihood Estimation from Incomplete Data , 1958 .

[5]  A. Cohen,et al.  Estimation of the Poisson Parameter from Truncated Samples and from Censored Samples , 1954 .

[6]  J. O. Irwin,et al.  138. Note: On the Estimation of the Mean of a Poisson Distribution from a Sample with the Zero Class Missing , 1959 .

[7]  P. R. Rider,et al.  Truncated Binomial and Negative Binomial Distributions , 1955 .

[8]  R. L. Goen,et al.  Minimum Variance Unbiased Estimation for the Truncated Poisson Distribution , 1958 .

[9]  David P. M. Scollnik.  On the Intervened Generalized Poisson Distribution , 2006 .

[10]  J. Maritz,et al.  On the validity of inferences drawn from the fitting of Poisson and negative binomial distributions to observed accident data. , 1950, Psychological bulletin.

[11]  D. Karlis.  An EM algorithm for multivariate Poisson distribution and related models , 2003 .

[12]  D. J. Finney,et al.  An Example of the Truncated Poisson Distribution , 1955 .

[13]  D. J. Finney,et al.  The truncated binomial distribution. , 1949, Annals of eugenics.

[14]  J. C. Ahuja.  Distribution of the Sum of Independent Decapitated Negative Binomial Variables , 1971 .

[15]  Richard T. Carson,et al.  Models for truncated counts , 1991 .

[16]  M. R. Sampford,et al.  THE TRUNCATED NEGATIVE BINOMIAL DISTRIBUTION , 1955 .

[17]  Xiao-Li Meng,et al.  Maximum likelihood estimation via the ECM algorithm: A general framework , 1993 .

[18]  T. Cacoullos,et al.  A Combinatorial Derivation of the Distribution of the Truncated Poisson Sufficient Statistic , 1961 .

[19]  K. Lange,et al.  MM Algorithms for Some Discrete Multivariate Distributions , 2010, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.

[20]  P. G. Moore,et al.  A note on truncated Poisson distributions , 1954 .

[21]  P. C. Consul,et al.  A Generalized Negative Binomial Distribution , 1971 .

[22]  Ganapati P. Patil,et al.  Minimum Variance Unbiased Estimation and Certain Problems of Additive Number Theory , 1963 .

[23]  Johan Springael,et al.  On the sum of independent zero-truncated Poisson random variables , 2006 .

[24]  L. Gold.  Generalized poisson distributions , 1957 .

[25]  Alan J. Gross,et al.  Estimating the Zero Class from a Truncated Poisson Sample , 1973 .

[26]  N. L. Johnson,et al.  Distributions in Statistics: Discrete Distributions. , 1970 .

[27]  D R Appleton,et al.  An application of the truncated Poisson distribution to immunogold assay. , 1993, Biometrics.

[28]  Felix Famoye,et al.  Lagrangian Probability Distributions , 2005 .

[29]  Olivier Thas,et al.  Goodness of fit for the zero-truncated Poisson distribution , 2007 .

[30]  X L Meng,et al.  The EM algorithm and medical studies: a historical linik , 1997, Statistical methods in medical research.

[31]  Henrick John Malik.  Distribution of the Sum of Truncated Binomial Variates , 1969, Canadian Mathematical Bulletin.

[32]  P. R. Rider,et al.  Truncated Poisson Distributions , 1953 .

[33]  P. Consul,et al.  A Generalization of the Poisson Distribution , 1973 .

[34]  A. Cohen,et al.  Estimating the Parameter in a Conditional Poisson Distribution , 1960 .

[35]  C. I. Bliss,et al.  FITTING THE NEGATIVE BINOMIAL DISTRIBUTION TO BIOLOGICAL DATA AND NOTE ON THE EFFICIENT FITTING OF THE NEGATIVE BINOMIAL , 1953 .

[36]  R Shanmugam,et al.  An intervened Poisson distribution and its medical application. , 1985, Biometrics.

[37]  J. C. Ahuja.  On the Distribution of Sum of Independent Positive Binomial Variables , 1970, Canadian Mathematical Bulletin.

[38]  C. Satheesh Kumar,et al.  On intervened negative binomial distribution and some of its properties , 2012 .

[39]  M Aickin,et al.  A truncated poisson regression model with applications to occurrence of adenomatous polyps. , 1997, Statistics in medicine.

[40]  Norman L. Johnson,et al.  The Truncated Poisson , 1952 .