The polynomial Fourier transform with minimum mean square error for noisy data

In 2006, Naoki Saito proposed a Polyharmonic Local Fourier Transform (PHLFT) to decompose a signal f@?L^2(@W) into the sum of a polyharmonic componentu and a residualv, where @W is a bounded and open domain in R^d. The solution presented in PHLFT in general does not have an error with minimal energy. In resolving this issue, we propose the least squares approximant to a given signal in L^2([-1,1]) using the combination of a set of algebraic polynomials and a set of trigonometric polynomials. The maximum degree of the algebraic polynomials is chosen to be small and fixed. We show in this paper that the least squares approximant converges uniformly for a Holder continuous function. Therefore Gibbs phenomenon will not occur around the boundary for such a function. We also show that the PHLFT converges uniformly and is a near least squares approximation in the sense that it is arbitrarily close to the least squares approximant in L^2 norm as the dimension of the approximation space increases. Our experiments show that the proposed method is robust in approximating a highly oscillating signal. Even when the signal is corrupted by noise, the method is still robust. The experiments also reveal that an optimum degree of the trigonometric polynomial is needed in order to attain the minimal l^2 error of the approximation when there is noise present in the data set. This optimum degree is shown to be determined by the intrinsic frequency of the signal. We also discuss the energy compaction of the solution vector and give an explanation to it.

[1]  P. Grünwald The Minimum Description Length Principle (Adaptive Computation and Machine Learning) , 2007 .

[2]  E. Cheney Introduction to approximation theory , 1966 .

[3]  Arnold Neumaier,et al.  Introduction to Numerical Analysis , 2001 .

[4]  Alan V. Oppenheim,et al.  Discrete-time Signal Processing. Vol.2 , 2001 .

[5]  Mark S. Gockenbach,et al.  Partial Differential Equations - Analytical and Numerical Methods (2. ed.) , 2011 .

[6]  Naoki Saito,et al.  Improvement of DCT-Based Compression Algorithms Using Poisson's Equation , 2006, IEEE Transactions on Image Processing.

[7]  Khaled H. Hamed,et al.  Time-frequency analysis , 2003 .

[8]  Henrique S. Malvar,et al.  The LOT: transform coding without blocking effects , 1989, IEEE Trans. Acoust. Speech Signal Process..

[9]  N. Saito,et al.  Simultaneous segmentation, compression, and denoising of signals using polyharmonic local sine transform and minimum description length criterion , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.

[10]  Yi Wang,et al.  PHLST5: A Practical and Improved Version of Polyharmonic Local Sine Transform , 2007, Journal of Mathematical Imaging and Vision.

[11]  Henrique S. Malvar Lapped transforms for efficient transform/subband coding , 1990, IEEE Trans. Acoust. Speech Signal Process..

[12]  Begnaud Francis Hildebrand,et al.  Introduction to numerical analysis: 2nd edition , 1987 .

[14]  P. Heywood Trigonometric Series , 1968, Nature.

[15]  K. Atkinson,et al.  Theoretical Numerical Analysis: A Functional Analysis Framework , 2001 .

[16]  Jorma Rissanen,et al.  Stochastic Complexity in Statistical Inquiry , 1989, World Scientific Series in Computer Science.

[17]  Y. Meyer,et al.  Remarques sur l'analyse de Fourier à fenêtre , 1991 .

[18]  Naoki Saito Jean-Franc The Polyharmonic Local Sine Transform: A New Tool for Local Image Analysis and Synthesis without Edge Effect ? , 2005 .