Noise Reduction for Ground-based Atmospheric Detection Lidar: A Universal Method Based on Signal Segmentation and Reconstruction

Abstract Atmospheric detection lidar is a powerful tool to achieve accurate detection of various elements of the atmosphere. However, noise is an unavoidable factor in the lidar signal, and it affects the analysis of the detection results. In this study, a universal de-noising algorithm based on signal segmentation and reconstruction is proposed to enhance the signal-to-noise ratio for ground-based atmospheric detection lidar. The proposed algorithm performs well in most cases The signal segmentation, which serves as the keystone of this universal algorithm, segments the signal into three parts: the noise-free signal, normal signal, and layer signal (if it exists). The two latter signal fragments must be processed by a de-noising method, which is a combination of the empirical mode decomposition (EMD) and the discrete wavelet transform (DWT) with a fixed wavelet base. The former one deals with the normal signal, and the latter one is designed to process the layer signal. The determination of the starting and ending bins of each signal fragment, the self-adaptive EMD, and a proper selection of DWT ensure that signal processing can be accomplished automatically without any artificial intervention. A series of simulation tests quantitatively shows the advantages of the proposed method. The dual field-of-view Mie lidar provides the possibility of de-noising evaluation based on real lidar data. Our method is proven as a universal and effective approach for de-noising processing of lidar signal.

[1]  Benjamin M. Herman,et al.  Determination of aerosol height distributions by lidar , 1972 .

[2]  Jun Li,et al.  Nonlinear physical segmentation algorithm for determining the layer boundary from lidar signal. , 2015, Optics express.

[3]  Ying Li,et al.  Application of the Ultraviolet Scanning Elastic Backscatter LiDAR for the Investigation of Aerosol Variability , 2015, Remote. Sens..

[4]  Kenneth Sassen,et al.  Cloud Type and Macrophysical Property Retrieval Using Multiple Remote Sensors , 2001 .

[5]  Bo Du,et al.  Spectral–Spatial Weighted Kernel Manifold Embedded Distribution Alignment for Remote Sensing Image Classification , 2020, IEEE Transactions on Cybernetics.

[6]  Kwangjin Kim,et al.  Satellite-Based Prediction of Arctic Sea Ice Concentration Using a Deep Neural Network with Multi-Model Ensemble , 2018, Remote. Sens..

[7]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .

[8]  Aime Lay-Ekuakille,et al.  Comparison between adjustable window technique and wavelet method in processing backscattering lidar signal , 2004, SPIE Remote Sensing.

[9]  Jie Huang,et al.  An improved EMD based on cubic spline interpolation of extremum centers , 2015 .

[10]  Venkataraman Sivakumar De-noising LiDAR signal using wavelet technique , 2007, SPIE Optical Engineering + Applications.

[11]  De-Shuang Huang,et al.  Antinoise approximation of the lidar signal with wavelet neural networks. , 2005, Applied optics.

[12]  Shihua Chen,et al.  De-noising and retrieving algorithm of Mie lidar data based on the particle filter and the Fernald method. , 2015, Optics express.

[13]  Zhishen Liu,et al.  Enhancement of lidar backscatters signal-to-noise ratio using empirical mode decomposition method , 2006 .

[14]  Zhaoyan Liu,et al.  Asian dust transported one full circuit around the globe , 2009 .

[15]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[16]  Liangsheng Qu,et al.  An improved method for restraining the end effect in empirical mode decomposition and its applications to the fault diagnosis of large rotating machinery , 2008 .

[17]  Lei Zhang,et al.  Improved empirical mode decomposition based denoising method for lidar signals , 2014 .

[18]  De-Shuang Huang,et al.  Noise reduction in lidar signal based on discrete wavelet transform , 2004 .

[19]  N. Laurendeau,et al.  Effect of pulsed dye-laser wavelength stabilization on spectral overlap in atmospheric NO fluorescence studies. , 1997, Applied optics.

[20]  Abdel-Ouahab Boudraa,et al.  EMD-Based Signal Filtering , 2007, IEEE Transactions on Instrumentation and Measurement.

[21]  Xin Ma,et al.  Measurement of CO2 rectifier effect during summer and winter using ground-based differential absorption LiDAR , 2020 .

[22]  Wei Gong,et al.  OFLID: Simple method of overlap factor calculation with laser intensity distribution for biaxial lidar , 2011 .

[23]  Wei Gong,et al.  Signal simplification and cloud detection with an improved Douglas-Peucker algorithm for single-channel lidar , 2011 .

[24]  Li Song,et al.  Regional Atmospheric Aerosol Pollution Detection Based on LiDAR Remote Sensing , 2019, Remote. Sens..

[25]  Yuzhao Wang,et al.  An adaptive segment method for smoothing lidar signal based on noise estimation , 2014, Remote Sensing.

[26]  J. Comstock,et al.  Ground‐based lidar and radar remote sensing of tropical cirrus clouds at Nauru Island: Cloud statistics and radiative impacts , 2002 .

[27]  Weibiao Chen,et al.  Quantifying CO2 Uptakes Over Oceans Using LIDAR: A Tentative Experiment in Bohai Bay , 2021, Geophysical Research Letters.

[28]  P. T. Woods,et al.  Measurements of toluene and other aromatic hydrocarbons by differential-absorption LIDAR in the near-ultraviolet , 1992 .

[29]  I. Brooks,et al.  Finding Boundary Layer Top: Application of a Wavelet Covariance Transform to Lidar Backscatter Profiles , 2003 .

[30]  J. Kokes,et al.  Using constrained cubic spline instead of natural cubic spline to eliminate overshoot and undershoot in Hilbert Huang Transform , 2012, Proceedings of the 13th International Carpathian Control Conference (ICCC).

[31]  Liu Zhenxing,et al.  An improved method for automatic determination of the planetary boundary layer height based on lidar data , 2020, Journal of Quantitative Spectroscopy and Radiative Transfer.

[32]  Stéphane Mallat,et al.  Singularity detection and processing with wavelets , 1992, IEEE Trans. Inf. Theory.

[33]  James D. Spinhirne,et al.  Micro pulse lidar , 1993, IEEE Trans. Geosci. Remote. Sens..

[34]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[35]  F. G. Fernald Analysis of atmospheric lidar observations: some comments. , 1984, Applied optics.

[36]  Gabriel Rilling,et al.  Empirical mode decomposition as a filter bank , 2004, IEEE Signal Processing Letters.

[37]  Vladimir A. Kovalev,et al.  Elastic Lidar: Theory, Practice, and Analysis Methods , 2004 .

[38]  Wei Gong,et al.  Linear segmentation algorithm for detecting layer boundary with lidar. , 2013, Optics express.

[39]  David D. Turner,et al.  Full-Time, Eye-Safe Cloud and Aerosol Lidar Observation at Atmospheric Radiation Measurement Program Sites: Instruments and Data Analysis , 2013 .

[40]  Daniele Bortoli,et al.  Infrared lidar overlap function: an experimental determination. , 2010, Optics express.

[41]  P. Yang,et al.  Study of the effects of phytoplankton morphology and vertical profile on lidar attenuated backscatter and depolarization ratio , 2019, Journal of Quantitative Spectroscopy and Radiative Transfer.