Improved double-threshold denoising method based on the wavelet transform

Preprocessing of spectral data is a key part of infrared spectroscopy and is an important basis for building robust models. Therefore, the measured signal needs to be preprocessed to achieve accurate and reliable measurement results. After sketching out the basic principles and basic methods of the wavelet transform, a new modified double-threshold denoising method combined with the proposed threshold method is presented in the paper. Two sets of comparative simulation experiments are also done to demonstrate the performance of the new denoising method. Block signals with a signal length of 2000 and the sinusoidal signal with a signal length of 1000 and the measured spectra are used for denoising with traditional schemes and the proposed method. The results of simulation data have demonstrated that the proposed method outperforms the traditional thresholding schemes for increasing the signal-to-noise ratio (SNR) without distorting the signal.

[1]  Hugh J. Byrne,et al.  Resonant Mie scattering (RMieS) correction of infrared spectra from highly scattering biological samples. , 2010, The Analyst.

[2]  P Stömmer [Experimental studies of adipose tissue necrosis in acute tryptic pancreatitis]. , 1983, Leber, Magen, Darm.

[3]  P. Griffiths,et al.  A low-resolution spectrometer for open-path Fourier-transform infrared spectrometry , 1999 .

[4]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[5]  J. Bertoin,et al.  A probabilistic approach to spectral analysis of growth-fragmentation equations , 2017, 1701.05061.

[6]  H. Mantsch,et al.  Determination of protein secondary structure by Fourier transform infrared spectroscopy: a critical assessment. , 1993, Biochemistry.

[7]  C. Lindsay Anderson,et al.  A New Wavelet Denoising Method for Selecting Decomposition Levels and Noise Thresholds , 2016, IEEE Access.

[8]  Jun Zhu,et al.  Research on analyzing atmospheric trasmittance based on infrared radiation measurements , 2005, Other Conferences.

[9]  Hui Liu,et al.  A de-noising method using the improved wavelet threshold function based on noise variance estimation , 2018 .

[10]  Dennis M. Healy,et al.  Wavelet transform domain filters: a spatially selective noise filtration technique , 1994, IEEE Trans. Image Process..

[11]  Jae Lim,et al.  Signal estimation from modified short-time Fourier transform , 1984 .

[12]  Chandrika Kamath,et al.  Denoising through wavelet shrinkage: an empirical study , 2003, J. Electronic Imaging.

[13]  T. D. Bui,et al.  Multiwavelets denoising using neighboring coefficients , 2003, IEEE Signal Processing Letters.

[14]  Jae Lim,et al.  Signal reconstruction from short-time Fourier transform magnitude , 1983 .

[15]  Guang Deng,et al.  A signal denoising algorithm based on overcomplete wavelet representations and Gaussian models , 2007, Signal Process..

[16]  W. M. Carey,et al.  Digital spectral analysis: with applications , 1986 .