Mean Squared Error Minimization for Inverse Moment Problems

We consider the problem of approximating the unknown density $$u\in L^2(\Omega ,\lambda )$$u∈L2(Ω,λ) of a measure $$\mu $$μ on $$\Omega \subset \mathbb {R}^n$$Ω⊂Rn, absolutely continuous with respect to some given reference measure $$\lambda $$λ, only from the knowledge of finitely many moments of $$\mu $$μ. Given $$d\in \mathbb {N}$$d∈N and moments of order $$d$$d, we provide a polynomial $$p_d$$pd which minimizes the mean square error $$\int (u-p)^2d\lambda $$∫(u-p)2dλ over all polynomials $$p$$p of degree at most $$d$$d. If there is no additional requirement, $$p_d$$pd is obtained as solution of a linear system. In addition, if $$p_d$$pd is expressed in the basis of polynomials that are orthonormal with respect to $$\lambda $$λ, its vector of coefficients is just the vector of given moments and no computation is needed. Moreover $$p_d\rightarrow u$$pd→u in $$L^2(\Omega ,\lambda )$$L2(Ω,λ) as $$d\rightarrow \infty $$d→∞. In general nonnegativity of $$p_d$$pd is not guaranteed even though $$u$$u is nonnegative. However, with this additional nonnegativity requirement one obtains analogous results but computing $$p_d\ge 0$$pd≥0 that minimizes $$\int (u-p)^2d\lambda $$∫(u-p)2dλ now requires solving an appropriate semidefinite program. We have tested the approach on some applications arising from the reconstruction of geometrical objects and the approximation of solutions of nonlinear differential equations. In all cases our results are significantly better than those obtained with the maximum entropy technique for estimating $$u$$u.

[1]  Robert M. Mnatsakanov,et al.  Moment-recovered approximations of multivariate distributions: The Laplace transform inversion , 2011 .

[2]  R. Ash,et al.  Real analysis and probability , 1975 .

[3]  S. Ghosh,et al.  Smooth density estimation with moment constraints using mixture distributions , 2011 .

[4]  R. Goodrich,et al.  $L_2 $ Spectral Estimation , 1986 .

[5]  Jonathan M. Borwein,et al.  On the convergence of moment problems , 1991 .

[6]  Miroslaw Pawlak,et al.  On Image Analysis by Moments , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[8]  L. Mead,et al.  Maximum entropy in the problem of moments , 1984 .

[9]  S. Provost Moment-Based Density Approximants , 2005 .

[10]  M. Teague Image analysis via the general theory of moments , 1980 .

[11]  J. Malick,et al.  Projection methods in conic optimization , 2011, 1103.1511.

[12]  A. Izenman Recent Developments in Nonparametric Density Estimation , 1991 .

[13]  Volker John,et al.  Techniques for the reconstruction of a distribution from a finite number of its moments , 2007 .

[14]  H. Landau Moments in mathematics , 1987 .

[15]  P. N. Gavriliadis,et al.  The truncated Stieltjes moment problem solved by using kernel density functions , 2012, J. Comput. Appl. Math..

[16]  R Pikes,et al.  Linear inverse problems with discrete data: II. Stability and regularisation , 1988 .

[17]  Didier Henrion,et al.  GloptiPoly 3: moments, optimization and semidefinite programming , 2007, Optim. Methods Softw..

[18]  G. Kerkyacharian,et al.  Density estimation by kernel and wavelets methods: Optimality of Besov spaces , 1993 .

[19]  Mario Bertero,et al.  Linear inverse problems with discrete data. I. General formulation and singular system analysis , 1985 .

[20]  I. Johnstone,et al.  Density estimation by wavelet thresholding , 1996 .

[21]  M. Vannucci Nonparametric Density Estimation using Wavelets , 1995 .

[22]  S. Kay Spectral estimation , 1987 .

[23]  G. A. Baker,et al.  Pade approximants. Part 2: Extensions and applications , 1981 .

[24]  Gerassimos A. Athanassoulis,et al.  The truncated Hausdorff moment problem solved by using kernel density functions , 2002 .

[25]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[26]  Jean B. Lasserre,et al.  A New Look at Nonnegativity on Closed Sets and Polynomial Optimization , 2010, SIAM J. Optim..

[27]  G. Talenti Recovering a function from a finite number of moments , 1987 .

[28]  J. Lasserre Moments, Positive Polynomials And Their Applications , 2009 .

[29]  Emmanuel Trélat,et al.  Nonlinear Optimal Control via Occupation Measures and LMI-Relaxations , 2007, SIAM J. Control. Optim..

[30]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[31]  A. Izenman Review Papers: Recent Developments in Nonparametric Density Estimation , 1991 .

[32]  M. Mimura Asymptotic Behaviors of a Parabolic System Related to a Planktonic Prey and Predator Model , 1979 .

[33]  On extending the orthogonality property of minimum norm solutions in Hilbert space to general methods for linear inverse problems , 1990 .

[34]  Didier Henrion,et al.  Moment and SDP relaxation techniques for smooth approximations of problems involving nonlinear differential equations , 2010, 1003.4608.