Nonparametric maximum likelihood computation of a U-shaped hazard function

A new algorithm is presented and studied in this paper for fast computation of the nonparametric maximum likelihood estimate of a U-shaped hazard function. It successfully overcomes a difficulty when computing a U-shaped hazard function, which is only properly defined by knowing its anti-mode, and the anti-mode itself has to be found during the computation. Specifically, the new algorithm maintains the constant hazard segment, regardless of its length being zero or positive. The length varies naturally, according to what mass values are allocated to their associated knots after each updating. Being an appropriate extension of the constrained Newton method, the new algorithm also inherits its advantage of fast convergence, as demonstrated by some real-world data examples. The algorithm works not only for exact observations, but also for purely interval-censored data, and for data mixed with exact and interval-censored observations.

[1]  Peter Hall,et al.  Nonparametric Estimation of Hazard Rate Under the Constraint of Monotonicity , 2001 .

[2]  Yong Wang On fast computation of the non‐parametric maximum likelihood estimate of a mixing distribution , 2007 .

[3]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[4]  Geurt Jongbloed,et al.  Nonparametric Estimation under Shape Constraints: Estimators, Algorithms and Asymptotics , 2014 .

[5]  U. Grenander On the theory of mortality measurement , 1956 .

[6]  E. Kaplan,et al.  Nonparametric Estimation from Incomplete Observations , 1958 .

[7]  Geurt Jongbloed,et al.  Estimating a Unimodal Distribution From Interval-Censored Data , 2006 .

[8]  Wei-Yann Tsai,et al.  Estimation of the survival function with increasing failure rate based on left truncated and right censored data , 1988 .

[9]  J. Klein,et al.  Survival Analysis: Techniques for Censored and Truncated Data , 1997 .

[10]  R. Peto,et al.  Experimental Survival Curves for Interval‐Censored Data , 1973 .

[11]  Elisa Lee,et al.  Statistical Methods for Survival Data Analysis: Lee/Survival Data Analysis , 2003 .

[12]  L. Reboul,et al.  Estimation of a function under shape restrictions. Applications to reliability , 2005, math/0507427.

[13]  Yong Wang,et al.  Dimension-reduced nonparametric maximum likelihood computation for interval-censored data , 2008, Comput. Stat. Data Anal..

[14]  H. D. Brunk,et al.  AN EMPIRICAL DISTRIBUTION FUNCTION FOR SAMPLING WITH INCOMPLETE INFORMATION , 1955 .

[15]  Anton Schick,et al.  Consistency of the GMLE with Mixed Case Interval‐Censored Data , 2000 .

[16]  C. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[17]  B. Turnbull Nonparametric Estimation of a Survivorship Function with Doubly Censored Data , 1974 .

[18]  Jon A Wellner,et al.  Computation of nonparametric convex hazard estimators via profile methods , 2009, Journal of nonparametric statistics.

[19]  Elisa T. Lee,et al.  Statistical Methods for Survival Data Analysis , 1994, IEEE Transactions on Reliability.

[20]  Jon A. Wellner,et al.  Interval censoring, case 2: alternative hypotheses , 1995 .

[21]  J. Wellner,et al.  The Support Reduction Algorithm for Computing Non‐Parametric Function Estimates in Mixture Models , 2008, Scandinavian journal of statistics, theory and applications.

[22]  Moulinath Banerjee,et al.  ESTIMATING MONOTONE, UNIMODAL AND U-SHAPED FAILURE RATES USING ASYMPTOTIC PIVOTS , 2008 .

[23]  Thomas J. Santner,et al.  Maximum likelihood estimation of the survival function based on censored data under hazard rate assumptions , 1981 .

[24]  Desale Habtzghi,et al.  Nonparametric estimation of density and hazard rate functions with shape restrictions , 2011 .

[25]  Jian Huang,et al.  Estimation of a Monotone Density or Monotone Hazard Under Random Censoring , 1995 .

[26]  Frank Proschan Theoretical Explanation of Observed Decreasing Failure Rate , 2000, Technometrics.

[27]  H. Barnett A Theory of Mortality , 1968 .

[28]  J. Wellner,et al.  Nonparametric estimation of a convex bathtub-shaped hazard function. , 2008, Bernoulli : official journal of the Bernoulli Society for Mathematical Statistics and Probability.

[29]  T. A. Bray,et al.  MAXIMUM LIKELIHOOD ESTIMATION OF A U-SHAPED FAILURE RATE FUNCTION , 1967 .