A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter

When using ultraviolet-visible spectroscopy (UV-visible spectroscopy) to detect water quality parameters, the measured absorption spectrum signal often contains a lot of interference information. Therefore, denoising is extremely important in spectrum data processing and analysis, which directly affects the subsequent quantitative analysis and information mining. Choosing an appropriate denoising method is key to improve the spectral analysis accuracy and promote the spectral analysis ability. In this paper, a new UV-visible absorption spectrum denoising method is proposed: a denoising method based on ensemble empirical mode decomposition (EEMD) and improved universal threshold filtering (EEMD-based method). The noisy UV-visible absorption spectrum signal is firstly decomposed into a finite set of band limited signals called intrinsic mode functions (IMFs) via EEMD. Spearman's rank correlation coefficient (Spearman's rho) is then used as a criterion for the IMFs dominated by noise or useful signals, and the improved universal threshold filtering method is applied to the noise dominant IMFs to eliminate the noise. Finally, the denoised UV-visible absorption spectrum signal is reconstructed. In order to discuss the effectiveness of the EEMD-based denoising method proposed in this paper, we compare it with various wavelet-based threshold denoising methods. Both methods have been implemented on synthetic signals with diverse waveforms (‘Blocks’, ‘Bumps’ and ‘Heavy sine’). It is demonstrated that the proposed method outperforms the wavelet-based methods. Then, the measured UV-visible absorption spectra with different SNR were denoised by the wavelet and proposed methods. The method proposed also performs well in the spectrum denoising experiment.

[1]  Minhao Yan,et al.  A de-noising algorithm to improve SNR of segmented gamma scanner for spectrum analysis , 2016 .

[2]  Said Gaci,et al.  The Use of Wavelet-Based Denoising Techniques to Enhance the First-Arrival Picking on Seismic Traces , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Steve McLaughlin,et al.  Development of EMD-Based Denoising Methods Inspired by Wavelet Thresholding , 2009, IEEE Transactions on Signal Processing.

[4]  Pedro M. Saraiva,et al.  Denoising and Signal-to-Noise Ratio Enhancement: Wavelet Transform and Fourier Transform , 2009 .

[5]  Norden E. Huang,et al.  Complementary Ensemble Empirical Mode Decomposition: a Novel Noise Enhanced Data Analysis Method , 2010, Adv. Data Sci. Adapt. Anal..

[6]  N. Huang,et al.  A new view of nonlinear water waves: the Hilbert spectrum , 1999 .

[7]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[8]  Zhi Zhou,et al.  A Denoising Method Based on EEMD and Interval-Thresholding Strategy , 2014 .

[9]  Wei Guo,et al.  New insights into the source of decadal increase in chemical oxygen demand associated with dissolved organic carbon in Dianchi Lake. , 2017, The Science of the total environment.

[10]  Jong-Myon Kim,et al.  Adaptive ECG denoising using genetic algorithm-based thresholding and ensemble empirical mode decomposition , 2016, Inf. Sci..

[11]  Yong Chen,et al.  Application of improved wavelet adaptive threshold de-noising algorithm in FBG demodulation , 2017 .

[12]  Matthew P. Miller,et al.  Freshwater DOM quantity and quality from a two-component model of UV absorbance. , 2012, Water research.

[13]  Jasmin Kevric,et al.  Performance evaluation of empirical mode decomposition, discrete wavelet transform, and wavelet packed decomposition for automated epileptic seizure detection and prediction , 2018, Biomed. Signal Process. Control..

[14]  Zhong Bo Peng,et al.  Application Research of the Signal Processing Method Based on Db5 Wavelet Transform in Leakage Location of Ship Pipeline , 2012 .

[15]  Yuanyuan Liu,et al.  EMD interval thresholding denoising based on similarity measure to select relevant modes , 2015, Signal Process..

[16]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[17]  M. R. Petraglia,et al.  A new wavelet selection method for partial discharge denoising , 2015 .

[18]  Gang Li,et al.  Dynamic spectrum extraction method based on independent component analysis combined dual-tree complex wavelet transform , 2017 .

[19]  R. Quian Quiroga Single-trial event-related potentials with wavelet denoising: method and applications , 2005 .

[20]  Yang Song,et al.  Ensemble EMD-based signal denoising using modified interval thresholding , 2017, IET Signal Process..

[21]  T. S. Radhakrishnan,et al.  Baseline drift removal and denoising of MCG data using EEMD: role of noise amplitude and the thresholding effect. , 2014, Medical engineering & physics.

[22]  Jiajun Han,et al.  Microseismic and seismic denoising via ensemble empirical mode decomposition and adaptive thresholding , 2015 .

[24]  Qi Li,et al.  Denoising of the Base Vibration Signal Based on EEMD , 2011 .

[25]  Seung-Hyun Lee,et al.  A Simple Wavelet Method for Automated Detection of Epileptic Neural Spikes in Electroencephalogram , 2010, Adv. Inf. Sci. Serv. Sci..

[26]  Wei Wu,et al.  Application of EMD Denoising Approach in Noisy Blind Source Separation , 2014, J. Commun..

[27]  S. Mahdi S. Kolbadi,et al.  Localization and de-noising seismic signals on SASW measurement by wavelet transform , 2013 .

[28]  Guangyou Fang,et al.  Application of the EEMD method for distinction and suppression of motion-induced noise in grounded electrical source airborne TEM system , 2017 .

[29]  T. Wang,et al.  Comparing the applications of EMD and EEMD on time-frequency analysis of seismic signal , 2012 .

[30]  Yaguo Lei,et al.  Application of the EEMD method to rotor fault diagnosis of rotating machinery , 2009 .

[31]  Yeung Sam Hung,et al.  A comparative analysis of Spearman's rho and Kendall's tau in normal and contaminated normal models , 2013, Signal Process..

[32]  Aydin Akan,et al.  Detrended fluctuation thresholding for empirical mode decomposition based denoising , 2014, Digit. Signal Process..

[33]  Norden E. Huang,et al.  The Multi-Dimensional Ensemble Empirical Mode Decomposition Method , 2009, Adv. Data Sci. Adapt. Anal..