The truncated Hausdorff moment problem solved by using kernel density functions

In this work, the problem of an efficient representation and its exploitation to the approximate determination of a compactly supported, continuous probability density function (pdf) from a finite number of its moments is addressed. The representation used is a finite superposition of kernel density functions. This representation preserves positivity and can approximate any continuous pdf as closely as it is required. The classical theory of the Hausdorff moment problem is reviewed in order to make clear how the theoretical results as, e.g. the moment bounds, can be exploited in the numerical procedure. Various difficulties arising from the well-known ill-posedness of the numerical moment problem have been identified and solved. The kernel coefficients of the pdf expansion are calculated by solving a constrained, non-negative least-square problem. The consistency, numerical convergence and robustness of the solution algorithm have been illustrated by numerical examples with unimodal and bimodal pdfs. Although this paper is restricted to univariate, compactly supported pdfs, the method can be extended to general pdfs either univariate or multivariate, with finite or infinite support.

[1]  Philip E. Gill,et al.  Practical optimization , 1981 .

[2]  B. Silverman Density estimation for statistics and data analysis , 1986 .

[3]  F. Hausdorff,et al.  Momentprobleme für ein endliches Intervall. , 1923 .

[4]  B. Lindsay Moment Matrices: Applications in Mixtures , 1989 .

[5]  S. Twomey Introduction to the Mathematics of Inversion in Remote Sensing and Indirect Measurements , 1997 .

[6]  David W. Scott,et al.  Multivariate Density Estimation: Theory, Practice, and Visualization , 1992, Wiley Series in Probability and Statistics.

[7]  C. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[8]  Direct derivation of response moment and cumulant equations for non-linear stochastic problems , 2000 .

[9]  H. O. Lancaster The Structure of Bivariate Distributions , 1958 .

[10]  Mircea Grigoriu,et al.  Nonlinear systems driven by polynomials of filtered Poisson processes , 1999 .

[11]  Mircea Grigoriu,et al.  Applied non-Gaussian processes : examples, theory, simulation, linear random vibration, and MATLAB solutions , 1995 .

[12]  Gerassimos A. Athanassoulis,et al.  Moment data can be analytically completed , 2003 .

[13]  D. Fasino Spectral properties of Hankel matrices and numerical solutions of finite moment problems , 1995 .

[14]  J. Shohat,et al.  The problem of moments , 1943 .

[15]  L. Shapley,et al.  Geometry of Moment Spaces , 1953 .

[16]  J. Trębicki,et al.  Maximum entropy principle in stochastic dynamics , 1990 .

[17]  C. Charlier A New Form of the Frequency Function. , 1930 .

[18]  Thomas F. Coleman,et al.  A Reflective Newton Method for Minimizing a Quadratic Function Subject to Bounds on Some of the Variables , 1992, SIAM J. Optim..

[19]  N. Akhiezer,et al.  The Classical Moment Problem. , 1968 .

[20]  Bruce G. Lindsay,et al.  Moment-Based Approximations of Distributions Using Mixtures: Theory and Applications , 2000 .

[21]  Earl H. Dowell,et al.  Parametric Random Vibration , 1985 .

[22]  Alexander V. Tikhonov,et al.  Ill-Posed Problems in Natural Sciences , 1989 .

[23]  J. Wheeler,et al.  Modified-Moments Method: Applications to Harmonic Solids , 1973 .

[24]  Gerassimos A. Athanassoulis,et al.  Probabilistic description of metocean parameters by means of kernel density models 1. Theoretical background and first results , 2002 .

[25]  Holger Dette,et al.  The Theory of Canonical Moments with Applications in Statistics, Probability, and Analysis , 1997 .

[26]  K. Sobczyk Stochastic Differential Equations: With Applications to Physics and Engineering , 1991 .

[27]  Kazimierz Sobczyk,et al.  Maximum entropy principle and non-stationary distributions of stochastic systems , 1996 .

[28]  A. N. Tikhonov Ill-posed problems in natural sciences : proceedings of the international conference held in Moscow, August 19-25, 1991 , 1992 .

[29]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[30]  G. Schuëller A state-of-the-art report on computational stochastic mechanics , 1997 .

[31]  A. Gallant,et al.  Semi-nonparametric Maximum Likelihood Estimation , 1987 .

[32]  H. O. Lancaster The chi-squared distribution , 1971 .

[33]  P. Spanos,et al.  Random vibration and statistical linearization , 1990 .

[34]  Béla Gyires Linear Approximations in Convex Metric Spaces and the Application in the Mixture Theory of Probability Theory , 1993 .

[35]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[36]  P. R. Nelson The algebra of random variables , 1979 .

[37]  G. Lorentz The degree of approximation by polynomials with positive coefficients , 1963 .

[38]  Y. Katznelson An Introduction to Harmonic Analysis: Interpolation of Linear Operators , 1968 .