Dehazing for Multispectral Remote Sensing Images Based on a Convolutional Neural Network With the Residual Architecture

Multispectral remote sensing images are often contaminated by haze, which causes low image quality. In this paper, a novel dehazing method based on a deep convolutional neural network (CNN) with the residual structure is proposed for multispectral remote sensing images. First, multiple CNN individuals with the residual structure are connected in parallel and each individual is used to learn a regression from the hazy image to the clear image. Then, the outputs of CNN individuals are fused with weight maps to produce the final dehazing result. In the designed network, the CNN individuals, mining multiscale haze features through multiscale convolutions, are trained using different levels of haze samples to achieve different dehazing abilities. In addition, the weight maps change with the haze distribution, and the fusion of the CNN individuals is adaptive. The designed network is end-to-end, and putting a hazy image into it, the clear scene can be restored. To train the network, a wavelength-dependent haze simulation method is proposed to generate labeled data, which can synthesize hazy multispectral images highly close to real conditions. Experimental results show that the proposed method can accurately remove the haze in each band of multispectral images under different scenes.

[1]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[3]  Ketan Tang,et al.  Investigating Haze-Relevant Features in a Learning Framework for Image Dehazing , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Peter Reinartz,et al.  Haze Detection and Removal in Remotely Sensed Multispectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[6]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Yong Du,et al.  Haze detection and removal in high resolution satellite image with wavelet analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[8]  A. Cantor Optics of the atmosphere--Scattering by molecules and particles , 1978, IEEE Journal of Quantum Electronics.

[9]  Rudolf Richter,et al.  Atmospheric correction of satellite data with haze removal including a haze/clear transition region , 1996 .

[10]  Wei Chen,et al.  Haze removal based on advanced haze-optimized transformation (AHOT) for multispectral imagery , 2010 .

[11]  Xinbo Gao,et al.  Haze removal for a single visible remote sensing image , 2017, Signal Process..

[12]  J. Cihlar,et al.  An image transform to characterize and compensate for spatial variations in thin cloud contamination of Landsat images , 2002 .

[13]  Huifang Li,et al.  An effective thin cloud removal procedure for visible remote sensing images , 2014 .

[14]  Liangpei Zhang,et al.  Single image haze removal considering sensor blur and noise , 2013, EURASIP J. Adv. Signal Process..

[15]  Zhiguo Jiang,et al.  Haze Removal for a Single Remote Sensing Image Based on Deformed Haze Imaging Model , 2015, IEEE Signal Processing Letters.

[16]  Wei Tang,et al.  Single Remote Sensing Image Dehazing , 2014, IEEE Geoscience and Remote Sensing Letters.

[17]  Xinbo Gao,et al.  Single satellite image dehazing via linear intensity transformation and local property analysis , 2016, Neurocomputing.

[18]  David J. Sakrison,et al.  The effects of a visual fidelity criterion of the encoding of images , 1974, IEEE Trans. Inf. Theory.

[19]  Javier Vazquez-Corral,et al.  Fusion-Based Variational Image Dehazing , 2017, IEEE Signal Processing Letters.

[20]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[21]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[22]  Lena Halounová,et al.  Haze removal for high‐resolution satellite data: a case study , 2007 .

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[25]  P. Chavez An improved dark-object subtraction technique for atmospheric scattering correction of multispectral data , 1988 .

[26]  Jianbo Hu,et al.  Haze detection, perfection and removal for high spatial resolution satellite imagery , 2011 .

[27]  Dai Qin,et al.  An improved method for cloud removal in ASTER data change detection , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[28]  Huifang Li,et al.  A Variational Gradient-based Fusion Method for Visible and SWIR Imagery , 2012 .

[29]  Zhiguo Jiang,et al.  No-Reference Assessment on Haze for Remote-Sensing Images , 2016, IEEE Geoscience and Remote Sensing Letters.