Parameters optimization for wavelet denoising based on normalized spectral angle and threshold constraint machine learning

Abstract. Wavelet parameters (e.g., wavelet type, level of decomposition) affect the performance of the wavelet denoising algorithm in hyperspectral applications. Current studies select the best wavelet parameters for a single spectral curve by comparing similarity criteria such as spectral angle (SA). However, the method to find the best parameters for a spectral library that contains multiple spectra has not been studied. In this paper, a criterion named normalized spectral angle (NSA) is proposed. By comparing NSA, the best combination of parameters for a spectral library can be selected. Moreover, a fast algorithm based on threshold constraint and machine learning is developed to reduce the time of a full search. After several iterations of learning, the combination of parameters that constantly surpasses a threshold is selected. The experiments proved that by using the NSA criterion, the SA values decreased significantly, and the fast algorithm could save 80% time consumption, while the denoising performance was not obviously impaired.

[1]  G. A Theory for Multiresolution Signal Decomposition : The Wavelet Representation , 2004 .

[2]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[3]  Wang Qiang,et al.  Wavelet Transform Method on Removing Spectral Noises of Hyperspectral Images , 2008 .

[4]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[5]  Qi-Zhong Lin,et al.  [Wavelet analysis and its application in denoising the spectrum of hyperspectral image]. , 2009, Guang pu xue yu guang pu fen xi = Guang pu.

[6]  Xiandong Ma,et al.  Automated wavelet selection and thresholding for PD detection , 2002 .

[7]  Helmi Zulhaidi Mohd Shafri,et al.  Determination of optimal wavelet denoising parameters for red edge feature extraction from hyperspectral data , 2009 .

[8]  Nikolay N. Ponomarenko,et al.  Methods and automatic procedures for processing images based on blind evaluation of noise type and characteristics , 2011 .

[9]  Abbas El Gamal,et al.  Analysis of temporal noise in CMOS photodiode active pixel sensor , 2001, IEEE J. Solid State Circuits.

[10]  Shen-En Qian,et al.  Noise reduction of hyperspectral imagery using hybrid spatial-spectral derivative-domain wavelet shrinkage , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Wei Liu,et al.  [Extraction of first derivative spectrum features of soil organic matter via wavelet de-noising]. , 2011, Guang pu xue yu guang pu fen xi = Guang pu.

[12]  Zheng Lan-Fen- De-noise of Hyperspectral Image Based on Wavelet Transformation , 2005 .

[13]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Robert O. Knuteson,et al.  Hyperspectral data noise characterization using principle component analysis: application to the atmospheric infrared sounder , 2007 .

[15]  Vladimir V. Lukin,et al.  Segmentation-based method for blind evaluation of noise variance in images , 2008 .

[16]  Marco Diani,et al.  Subspace-Based Striping Noise Reduction in Hyperspectral Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Marco Diani,et al.  Signal-Dependent Noise Modeling and Model Parameter Estimation in Hyperspectral Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Chi-Farn Chen,et al.  Wavelet filtering of time-series moderate resolution imaging spectroradiometer data for rice crop mapping using support vector machines and maximum likelihood classifier , 2011 .

[19]  P. Mather,et al.  Wavelet-based denoising for derivative spectra analysis , 2002 .

[20]  F. Meer The effectiveness of spectral similarity measures for the analysis of hyperspectral imagery , 2006 .