A Greedy Algorithm for Unimodal Kernel Density Estimation by Data Sharpening

We consider the problem of nonparametric density estimation where estimates are constrained to be unimodal. Though several methods have been proposed to achieve this end, each of them has its own drawbacks and none of them have readily-available computer codes. The approach of Braun and Hall (2001), where a kernel density estimator is modified by data sharpening, is one of the most promising options, but optimization difficulties make it hard to use in practice. This paper presents a new algorithm and MATLAB code for finding good unimodal density estimates under the Braun and Hall scheme. The algorithm uses a greedy, feasibility-preserving strategy to ensure that it always returns a unimodal solution. Compared to the incumbent method of optimization, the greedy method is easier to use, runs faster, and produces solutions of comparable quality. It can also be extended to the bivariate case.

[1]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[2]  Peter Hall,et al.  UNIMODAL DENSITY ESTIMATION USING KERNEL METHODS , 2002 .

[3]  W. John Braun,et al.  Data Sharpening for Nonparametric Inference Subject to Constraints , 2001 .

[4]  L. Reboul,et al.  Estimation of a function under shape restrictions. Applications to reliability , 2005, math/0507427.

[5]  T. Gasser,et al.  Nonparametric Density Estimation under Unimodality and Monotonicity Constraints , 1999 .

[6]  Peter J. Bickel,et al.  SOME PROBLEMS ON THE ESTIMATION OF UNIMODAL DENSITIES , 1996 .

[7]  Luc Devroye,et al.  Combinatorial methods in density estimation , 2001, Springer series in statistics.

[8]  Peter Hall,et al.  Attributing a probability to the shape of a probability density , 2004 .

[9]  Kee-Hoon Kang,et al.  Unimodal kernel density estimation by datra sharpening , 2005 .

[10]  M. C. Jones,et al.  A reliable data-based bandwidth selection method for kernel density estimation , 1991 .

[11]  Anne-Laure Fougères,et al.  Estimation de densités unimodales , 1997 .

[12]  Frederick S. Hillier,et al.  Introduction to Operations Research (3rd ed.). , 1982 .

[13]  Nancy E. Heckman,et al.  Estimating and depicting the structure of a distribution of random functions , 2002 .

[14]  R B Fitzsimons,et al.  KIDNEY LENGTH IN THE NEWBORN MEASURED BY ULTRASOUND , 1983, Acta paediatrica Scandinavica.

[15]  R. Tapia,et al.  Nonparametric Probability Density Estimation , 1978 .

[16]  B. Silverman.  Density estimation for statistics and data analysis , 1986 .

[17]  L. Birge,et al.  Estimation of unimodal densities without smoothness assumptions , 1997 .

[18]  Umberto Alibrandi,et al.  Efficient evaluation of the pdf of a random variable through the kernel density maximum entropy approach , 2008 .

[19]  M. Wand.  Fast Computation of Multivariate Kernel Estimators , 1994 .

[20]  U. Grenander.  On the theory of mortality measurement , 1956 .

[21]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[22]  Christopher F. Parmeter,et al.  CONSTRAINED NONPARAMETRIC KERNEL REGRESSION: ESTIMATION AND INFERENCE , 2008 .