Single Image Defogging Based on Illumination Decomposition for Visual Maritime Surveillance

Single image fog removal is important for surveillance applications, and, recently, many defogging methods have been proposed. Due to the adverse atmospheric conditions, the scattering properties of foggy images depend on not only the depth information of scene but also the atmospheric aerosol model, which has a more prominent influence on illumination in a fog scene than that in a haze scene. However, the recent defogging methods confuse haze and fog, and they fail to consider fully the scattering properties. Thus, these methods are not sufficient to remove fog effects, especially for images in maritime surveillance. Therefore, this paper proposes a single image defogging method for visual maritime surveillance. First, a comprehensive scattering model is proposed to formulate a fog image in the glow-shaped environmental illumination. Then, an illumination decomposition algorithm is proposed to eliminate the glow effect on the airlight radiance and recover a fog layer, in which the objects at the infinite distance have uniform luminance. Second, a transmission-map estimation based on the non-local haze-lines prior is utilized to constrain the transmission map into a reasonable range for the input fog image. Finally, the proposed illumination compensation algorithm enables the defogging image to preserve the natural illumination information of the input image. In addition, a fog image dataset is established for the visual maritime surveillance. The experimental results based on the established dataset demonstrate that the proposed method can outperform the state-of-the-art methods in terms of both the subjective and objective evaluation criteria. Moreover, the proposed method can effectively remove fog and maintain naturalness for fog images.

[1]  Cheng Zhang,et al.  An effective fusion defogging approach for single sea fog image , 2016, Neurocomputing.

[2]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[3]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[4]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[5]  Truong Q. Nguyen,et al.  A No-Reference Perceptual Based Contrast Enhancement Metric for Ocean Scenes in Fog , 2013, IEEE Transactions on Image Processing.

[6]  Y. Rao,et al.  Generalized Equalization Model for Image Enhancement , 2016 .

[7]  Ming Zhao,et al.  Robust Infrared Maritime Target Detection Based on Visual Attention and Spatiotemporal Filtering , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[8]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[9]  Michael S. Brown,et al.  Nighttime Haze Removal with Glow and Multiple Light Colors , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[11]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[12]  Dengyin Zhang,et al.  Single image haze removal based on the improved atmospheric scattering model , 2017, Neurocomputing.

[13]  Minh N. Do,et al.  Robust Image and Video Dehazing with Visual Artifact Suppression via Gradient Residual Minimization , 2016, ECCV.

[14]  Yong Xu,et al.  Review of Video and Image Defogging Algorithms and Related Studies on Image Restoration and Enhancement , 2016, IEEE Access.

[15]  Deepu Rajan,et al.  MuSCoWERT: multi-scale consistence of weighted edge Radon transform for horizon detection in maritime images. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  A. Cantor Optics of the atmosphere--Scattering by molecules and particles , 1978, IEEE Journal of Quantum Electronics.

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Raanan Fattal,et al.  Dehazing Using Color-Lines , 2014, ACM Trans. Graph..

[20]  Bo Li,et al.  Image enhancement based on Retinex and lightness decomposition , 2011, 2011 18th IEEE International Conference on Image Processing.

[21]  Hai-Miao Hu,et al.  Naturalness Preserved Nonuniform Illumination Estimation for Image Enhancement Based on Retinex , 2017, IEEE Transactions on Multimedia.

[22]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[23]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[24]  Jean-Philippe Tarel,et al.  BLIND CONTRAST ENHANCEMENT ASSESSMENT BY GRADIENT RATIOING AT VISIBLE EDGES , 2011 .

[25]  John E. Tyler,et al.  The nature of light and colour in the open air , 1954 .

[26]  Li Yang,et al.  Fog Density Estimation and Image Defogging Based on Surrogate Modeling for Optical Depth , 2017, IEEE Transactions on Image Processing.

[27]  Wonha Kim,et al.  Single Image Dehazing Using Color Ellipsoid Prior , 2018, IEEE Transactions on Image Processing.

[28]  Alan Conrad Bovik,et al.  Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging , 2015, IEEE Transactions on Image Processing.

[29]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Dan Feng,et al.  Benchmarking Single-Image Dehazing and Beyond , 2017, IEEE Transactions on Image Processing.

[31]  Manuel Rosa-Zurera,et al.  Ship detection by different data selection templates and multilayer perceptrons from incoherent maritime radar data , 2011 .

[32]  Deepu Rajan,et al.  Video Processing From Electro-Optical Sensors for Object Detection and Tracking in a Maritime Environment: A Survey , 2016, IEEE Transactions on Intelligent Transportation Systems.

[33]  Yuan-Kai Wang,et al.  Single Image Defogging by Multiscale Depth Fusion , 2014, IEEE Transactions on Image Processing.

[34]  Shree K. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[35]  Akira Ishimaru,et al.  Wave propagation and scattering in random media , 1997 .

[36]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  N. A. Logan Survey of some early studies of the scattering of plane waves by a sphere , 1965 .

[38]  Meigen Zhang,et al.  Analysis and high-resolution modeling of a dense sea fog event over the Yellow Sea , 2006 .

[39]  Hai-Miao Hu,et al.  Naturalness Preserved Enhancement Algorithm for Non-Uniform Illumination Images , 2013, IEEE Transactions on Image Processing.

[40]  Shree K. Nayar,et al.  Shedding light on the weather , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[41]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[42]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[43]  Yang Zhang,et al.  Ship detection for visual maritime surveillance from non-stationary platforms☆ , 2017 .

[44]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[45]  Michael Elad,et al.  Retinex by Two Bilateral Filters , 2005, Scale-Space.