A Deconvolution Technology of Microwave Radiometer Data Using Convolutional Neural Networks

Microwave radiometer data is affected by many factors during the imaging process, including the antenna pattern, system noise, and the curvature of the Earth. Existing deconvolution methods such as Wiener filtering handle this degradation problem in the Fourier domain. However, under complex degradation conditions, the Wiener filtering results are not accurate. In this paper, a convolutional neural network (CNN) model is proposed to solve the degradation problem. The deconvolution procedure is defined as a regression problem in the spatial domain that can be solved with deep learning. For the real inverse process of microwave radiometer data, the CNN model has a more powerful reconstruction ability than Wiener filtering due to the multi-layer structure of the CNN, which enables the multiple feature transform of the data. Additionally, the complex degradation factor during the imaging process of a microwave radiometer can be solved with general framework-based learning. Experimental results demonstrated that the CNN model gains about 5 dB at the peak signal-to-noise ratio compared to the Wiener filtering deconvolution method, and can better distinguish the measured data.

[1]  Eric A. Smith,et al.  Spatial resolution enhancement of terrestrial features using deconvolved SSM/I microwave brightness temperatures , 1992, IEEE Trans. Geosci. Remote. Sens..

[2]  Jungang Miao,et al.  Resolution enhancement of passive microwave images from geostationary Earth orbit via a projective sphere coordinate system , 2014 .

[3]  David G. Long,et al.  Image reconstruction and enhanced resolution imaging from irregular samples , 2001, IEEE Trans. Geosci. Remote. Sens..

[4]  Arundhati Misra,et al.  Brightness Temperature Reconstruction Using BGI , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Dacheng Tao,et al.  Recent Progress in Image Deblurring , 2014, ArXiv.

[6]  T. Jackson,et al.  Soil moisture estimates from TRMM Microwave Imager observations over the Southern United States , 2003 .

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Eric A. Smith,et al.  The Impact of Spatial Resolution Enhancement of SSM/I Microwave Brightness Temperatures on Rainfall Retrieval Algorithms , 1994 .

[9]  G. Backus,et al.  Numerical Applications of a Formalism for Geophysical Inverse Problems , 1967 .

[10]  Georg Heygster,et al.  Image Deconvolution Techniques For Reconstruction Of Ssm/i Data , 1991, [Proceedings] IGARSS'91 Remote Sensing: Global Monitoring for Earth Management.

[11]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[12]  Bernhard Schölkopf,et al.  A Machine Learning Approach for Non-blind Image Deconvolution , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  S. Dietrich,et al.  MTG: resolution enhancement for MW measurements from geostationary orbits , 2006 .

[14]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[15]  Aurélien Ducournau,et al.  Deep learning for ocean remote sensing: an application of convolutional neural networks for super-resolution on satellite-derived SST data , 2016, 2016 9th IAPR Workshop on Pattern Recogniton in Remote Sensing (PRRS).

[16]  Richard Sethmann,et al.  Spatial resolution improvement of SSM/I data with image restoration techniques , 1994, IEEE Trans. Geosci. Remote. Sens..

[17]  Shengli Wu,et al.  Instrument performance and cross calibration of FY-3C MWRI , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[18]  Kyoung Mu Lee,et al.  Deeply-Recursive Convolutional Network for Image Super-Resolution , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Wangmeng Zuo,et al.  Learning Deep CNN Denoiser Prior for Image Restoration , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  S. Paloscia,et al.  Microwave Emission and Plant Water Content: A Comparison between Field Measurements and Theory , 1986, IEEE Transactions on Geoscience and Remote Sensing.

[21]  David G. Long,et al.  Spatial resolution enhancement of SSM/I data , 1998, IEEE Trans. Geosci. Remote. Sens..

[22]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[23]  Marco Tedesco,et al.  Identification of atmospheric influences on the estimation of snow water equivalent from AMSR-E measurements , 2007 .

[24]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[25]  N. Grody Classification of snow cover and precipitation using the special sensor microwave imager , 1991 .

[26]  Stefan Harmeling,et al.  Image denoising: Can plain neural networks compete with BM3D? , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  G. Backus,et al.  Uniqueness in the inversion of inaccurate gross Earth data , 1970, Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences.

[28]  G. Huffman,et al.  A Screening Methodology for Passive Microwave Precipitation Retrieval Algorithms , 1998 .

[29]  Claudio Estatico,et al.  On the Spatial Resolution Enhancement of Microwave Radiometer Data in Banach Spaces , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Bing Lin,et al.  Remote Sensing of Evapotranspiration and Carbon Uptake at Harvard Forest , 2006 .

[31]  Jun Yang,et al.  Overview of FY-3 Payload and Ground Application System , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[32]  S. Dietrich,et al.  Resolution enhancement for microwave‐based atmospheric sounding from geostationary orbits , 2008 .

[33]  Richard K. Moore,et al.  Microwave remote sensing fundamentals and radiometry , 1981 .

[34]  David G. Long,et al.  Resolution enhancement of spaceborne scatterometer data , 1993, IEEE Trans. Geosci. Remote. Sens..

[35]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[37]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[38]  G. Backus,et al.  The Resolving Power of Gross Earth Data , 1968 .

[39]  Liangpei Zhang,et al.  A universal remote sensing image quality improvement method with deep learning , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[40]  Jie Su,et al.  Dual-polarized ratio algorithm for retrieving Arctic sea ice concentration from passive microwave brightness temperature , 2013, Journal of Oceanography.

[41]  Hu Yang,et al.  The FengYun-3 Microwave Radiation Imager On-Orbit Verification , 2011, IEEE Transactions on Geoscience and Remote Sensing.