Joint Gamma correction and multi-resolution fusion scheme for enhancing haze degraded images

Abstract. The presence of haze degrades the quality of a captured image. The aerosols in the atmosphere cause scattering of the incident light, and this phenomenon is observed on the captured image as well, where some regions appear grayish and colors in those regions appear faded. To improve the quality of the hazy images, we propose a joint fusion and restoration model that sufficiently enhances the contrast of the hazy image while preserving its mean brightness. The fusion model utilizes images of various exposures generated by a modified Gamma correction model. The images for fusion are selected using some selection criteria and fused in a multi-resolution decomposition scheme. Three haze-sensitive weight maps corresponding to some statistical property of haze namely, saliency, illumination, and luminance gradient are constructed. The hazy image formation model is then used and dehazing is performed based on the dark channel prior assumption. The proposed algorithm does not consider the estimation of airlight vector which seldom cause over-saturation defect, instead a mean brightness preservation model has been applied. The variety of experiments demonstrate the significance of the proposed method.

[1]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[2]  Lei Cao,et al.  Polarimetric dehazing utilizing spatial frequency segregation of images. , 2015, Applied optics.

[3]  Prabir Kumar Biswas,et al.  Color Cast Dependent Image Dehazing via Adaptive Airlight Refinement and Non-Linear Color Balancing , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Ling-Yu Duan,et al.  Multi-scale Optimal Fusion model for single image dehazing , 2019, Signal Process. Image Commun..

[5]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.

[6]  Yoav Y Schechner,et al.  Polarization-based vision through haze. , 2008, Applied optics.

[7]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[8]  Isha Mehra,et al.  Image fusion using wavelet transform and its application to asymmetric cryptosystem and hiding. , 2014, Optics express.

[9]  Prabir Kumar Biswas,et al.  Enhancement of dark and low-contrast images using dynamic stochastic resonance , 2013, IET Image Process..

[10]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[11]  Yi Wei,et al.  Research on polarization dehazing through the coaxial and multi-aperture polarimetric camera , 2019 .

[12]  Shuai Fang,et al.  Image dehazing using polarization effects of objects and airlight. , 2014, Optics express.

[13]  Marcelo Bertalmío,et al.  Physical-based optimization for non-physical image dehazing methods. , 2020, Optics express.

[14]  J. Alex Stark,et al.  Adaptive image contrast enhancement using generalizations of histogram equalization , 2000, IEEE Trans. Image Process..

[15]  Zhiqin Zhu,et al.  A Novel Fast Single Image Dehazing Algorithm Based on Artificial Multiexposure Image Fusion , 2021, IEEE Transactions on Instrumentation and Measurement.

[16]  Zia-ur Rahman,et al.  Multi-scale retinex for color image enhancement , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[17]  Jian Liang,et al.  Polarimetric dehazing method for dense haze removal based on distribution analysis of angle of polarization. , 2015, Optics express.

[18]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Dan Feng,et al.  Benchmarking Single-Image Dehazing and Beyond , 2017, IEEE Transactions on Image Processing.

[20]  Nam Ik Cho,et al.  A Multi-Exposure Image Fusion Based on the Adaptive Weights Reflecting the Relative Pixel Intensity and Global Gradient , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[21]  G. R. Tobin,et al.  The study of logarithmic image processing model and its application to image enhancement , 1995, IEEE Trans. Image Process..

[22]  Ulises Cortés,et al.  Fast Single Image Defogging With Robust Sky Detection , 2020, IEEE Access.

[23]  Wencheng Wu,et al.  The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations , 2005 .

[24]  Yuan Ning,et al.  Multilayer Fusion and Chunk-Based Transmittance Estimation for Natural Hazy Image Enhancement , 2019, IEEE Access.

[25]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[26]  Vijay Kumar,et al.  Single image dehazing using gradient channel prior , 2019, Applied Intelligence.

[27]  Manjit Kaur,et al.  Color image dehazing using gradient channel prior and guided L0 filter , 2020, Inf. Sci..

[28]  Naveen K. Nishchal,et al.  An improved Gamma correction model for image dehazing in a multi-exposure fusion framework , 2021, J. Vis. Commun. Image Represent..

[29]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[31]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[32]  Radu Timofte,et al.  O-HAZE: A Dehazing Benchmark with Real Hazy and Haze-Free Outdoor Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[33]  Rajib Kumar Jha,et al.  Enhancement of dark images using dynamic stochastic resonance with anisotropic diffusion , 2016, J. Electronic Imaging.

[34]  Wei Liu,et al.  Gated Fusion Network for Single Image Dehazing , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]  Gaurav Sharma,et al.  HazeRD: An outdoor scene dataset and benchmark for single image dehazing , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[36]  Hua Lee,et al.  An Efficient Fusion-Based Defogging , 2017, IEEE Transactions on Image Processing.

[37]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[38]  Jinyong Jeong,et al.  Model-Assisted Multiband Fusion for Single Image Enhancement and Applications to Robot Vision , 2018, IEEE Robotics and Automation Letters.

[39]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[40]  Jian Liang,et al.  Real-time image haze removal using an aperture-division polarimetric camera. , 2017, Applied optics.

[41]  Jun Li,et al.  Single image dehazing via self-constructing image fusion , 2020, Signal Process..

[42]  Adrian Galdran,et al.  Image dehazing by artificial multiple-exposure image fusion , 2018, Signal Process..

[43]  Moon Gi Kang,et al.  Single image dehazing via atmospheric scattering model-based image fusion , 2021, Signal Process..

[44]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[45]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[46]  Yin Gao,et al.  Single Fog Image dehazing via fast Multi-scale Image Fusion , 2019 .

[47]  Yanyun Qu,et al.  Enhanced Pix2pix Dehazing Network , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.