A filtered polynomial approach to density estimation

In this paper, a little known computational approach to density estimation based on filtered polynomial approximation is investigated. It is accompanied by the first online available density estimation computer program based on a filtered polynomial approach. The approximation yields the unknown distribution and density as the product of a monotonic increasing polynomial and a filter. The filter may be considered as a target distribution which gets fixed prior to the estimation. The filtered polynomial approach then provides coefficient estimates for (close) algebraic approximations to (a) the unknown density function and (b) the unknown cumulative distribution function as well as (c) a transformation (e.g., normalization) from the unknown data distribution to the filter. This approach provides a high degree of smoothness in its estimates for univariate as well as for multivariate settings. The nice properties as the high degree of smoothness and the ability to select from different target distributions are suited especially in MCMC simulations. Two applications in Sects. 1 and 7 will show the advantages of the filtered polynomial approach over the commonly used kernel estimation method.

[1]  Steven N. MacEachern,et al.  Classification via kernel product estimators , 1998 .

[2]  H. Bozdogan Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions , 1987 .

[3]  C. Elphinstone,et al.  A target distribution model for nonparametric density estimation , 1983 .

[4]  S. Jaschke The Cornish-Fisher-Expansion in the Context of Delta - Gamma - Normal Approximations , 2002 .

[5]  B. Silverman Density estimation for statistics and data analysis , 1986 .

[6]  Peter Dalgaard,et al.  R Development Core Team (2010): R: A language and environment for statistical computing , 2010 .

[7]  M. Stone An Asymptotic Equivalence of Choice of Model by Cross‐Validation and Akaike's Criterion , 1977 .

[8]  Gene H. Golub,et al.  Matrix computations , 1983 .

[9]  M. Kendall,et al.  The advanced theory of statistics , 1945 .

[10]  Steven G. Krantz,et al.  Handbook of Complex Variables , 1999 .

[11]  I. Jolliffe Principal Component Analysis , 2002 .

[12]  David H. Bailey,et al.  Multiprecision Translation and Execution of Fortran Programs , 1993 .

[13]  O. Linton,et al.  A kernel method of estimating structured nonparametric regression based on marginal integration , 1995 .

[14]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[15]  N. L. Johnson,et al.  Multivariate Analysis , 1958, Nature.

[16]  David H. Bailey,et al.  Algorithm 719: Multiprecision translation and execution of FORTRAN programs , 1993, TOMS.

[17]  Peter Lancaster,et al.  Error analysis for the Newton-Raphson method , 1966 .