Nighttime Single Image Dehazing Based on the Structural Patch Decomposition

Images acquired from the outdoors are often degraded owing to bad weather conditions, such as haze, fog, and rain. Various algorithms for dehazing daytime images have been introduced to eliminate the effects of haze. However, unlike daytime conditions, where sunlight is the main source of light, there are multiple regional light sources in nighttime conditions. Thus, it is difficult to effectively eliminate the effects of haze at night using dehazing algorithms that primarily target daytime hazy images. In addition, most nighttime dehazing algorithms adopt the dark channel prior (DCP) to estimate the transmission, but this approach has problems due to the spatially variant illuminations. In this paper, we propose a nighttime single image dehazing algorithm based on the structural patch decomposition. First, atmospheric light is estimated by separating the intensity and color of light. To estimate the transmission, the candidates for the transmission values are set, and the final transmission value is obtained based on a weighted summation of these candidates for each image pixel. The weights of the candidates are determined according to the structural patch information of the scene radiances estimated with these candidates. Using this approach, an appropriate transmission map can be obtained, and the dehazing procedure is shown to be robust to the mixed illumination conditions observed in the nighttime conditions. The experimental results show that the proposed algorithm effectively eliminate the effect of haze in images based on quantitative and qualitative evaluations.

[1]  Shree K. Nayar,et al.  Removing weather effects from monochrome images , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Jizheng Xu,et al.  AOD-Net: All-in-One Dehazing Network , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[4]  N. Gemini,et al.  An Improved Dark-Object Subtraction Technique for Atmospheric Scattering Correction of Multispectral Data* , 1988 .

[5]  Christophe De Vleeschouwer,et al.  Day and Night-Time Dehazing by Local Airlight Estimation , 2020, IEEE Transactions on Image Processing.

[6]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Kai Zeng,et al.  Perceptual Quality Assessment for Multi-Exposure Image Fusion , 2015, IEEE Transactions on Image Processing.

[8]  Ling-Yu Duan,et al.  Multi-scale Optimal Fusion model for single image dehazing , 2019, Signal Process. Image Commun..

[9]  Jing Zhang,et al.  Nighttime haze removal based on a new imaging model , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[10]  Bhabatosh Chanda,et al.  Learning a Patch Quality Comparator for Single Image Dehazing , 2018, IEEE Transactions on Image Processing.

[11]  Wencheng Wu,et al.  The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations , 2005 .

[12]  Zhengfang Duanmu,et al.  Multi-Exposure Image Fusion by Optimizing A Structural Similarity Index , 2018, IEEE Transactions on Computational Imaging.

[13]  Guowei Yang,et al.  Nighttime Single Image Dehazing via Pixel-Wise Alpha Blending , 2019, IEEE Access.

[14]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[15]  Vishal M. Patel,et al.  Densely Connected Pyramid Dehazing Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[16]  Sos S. Agaian,et al.  No reference color image contrast and quality measures , 2013, IEEE Transactions on Consumer Electronics.

[17]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[18]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[19]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[20]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.

[21]  Lei Zhang,et al.  Robust Multi-Exposure Image Fusion: A Structural Patch Decomposition Approach , 2017, IEEE Transactions on Image Processing.

[22]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[23]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Soo-Chang Pei,et al.  Nighttime haze removal using color transfer pre-processing and Dark Channel Prior , 2012, 2012 19th IEEE International Conference on Image Processing.

[25]  Sven Loncaric,et al.  Improving the white patch method by subsampling , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[26]  P. Chavez An improved dark-object subtraction technique for atmospheric scattering correction of multispectral data , 1988 .

[27]  Jing Zhang,et al.  Fast Haze Removal for Nighttime Image Using Maximum Reflectance Prior , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Michael S. Brown,et al.  Nighttime Haze Removal with Glow and Multiple Light Colors , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[29]  A. Cantor Optics of the atmosphere--Scattering by molecules and particles , 1978, IEEE Journal of Quantum Electronics.

[30]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[31]  Moon Gi Kang,et al.  Single image dehazing via atmospheric scattering model-based image fusion , 2021, Signal Process..

[32]  Jongmin Park,et al.  NTIRE 2020 Challenge on NonHomogeneous Dehazing , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[33]  Mark S. Drew,et al.  The Role of Bright Pixels in Illumination Estimation , 2012, Color Imaging Conference.

[34]  Minmin Yang,et al.  Superpixel-Based Single Nighttime Image Haze Removal , 2018, IEEE Transactions on Multimedia.

[35]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[36]  Alan Conrad Bovik,et al.  Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging , 2015, IEEE Transactions on Image Processing.

[37]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Junzhi Yu,et al.  Boosting dark channel dehazing via weighted local constant assumption , 2020, Signal Process..

[39]  Shree K. Nayar,et al.  Vision in bad weather , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[40]  Xiongkuo Min,et al.  Objective Quality Evaluation of Dehazed Images , 2019, IEEE Transactions on Intelligent Transportation Systems.