Fast Region-Adaptive Defogging and Enhancement for Outdoor Images Containing Sky

Inclement weather, haze, and fog severely decrease the performance of outdoor imaging systems. Due to a large range of the depth-of-field, most image dehazing or enhancement methods suffer from color distortions and halo artifacts when applied to real-world hazy outdoor scenes, especially those with the sky. To effectively recover details in both distant and nearby regions as well as to preserve color fidelity of the sky, in this study, we propose a novel image defogging and enhancement approach based on a replaceable plug-in segmentation module and region-adaptive processing. First, regions of the grayish sky, pure white objects, and other parts are separated. Second, a luminance-inverted multi-scale Retinex with color restoration (MSRCR) and region-ratio-based adaptive Gamma correction are applied to non-grayish and non-white areas. Finally, the enhanced regions are stitched seamlessly by using a mean-filtered region mask. Extensive experiments show that the proposed approach not only outperforms several state-of-the-art defogging methods in terms of both visibility and color fidelity, but also provides enhanced outputs with fewer artifacts and halos, particularly in sky regions.

[1]  Jun Chen,et al.  GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazing , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[2]  Vijay Kumar,et al.  Comprehensive survey on haze removal techniques , 2018, Multimedia Tools and Applications.

[3]  Alessandro Bria,et al.  On the Duality Between Retinex and Image Dehazing , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Jie Wang,et al.  Image Processing Technology in Fog and Haze Environment Based on Retinex Theory , 2018, DEStech Transactions on Computer Science and Engineering.

[5]  Weidong Zhang,et al.  Retinex-Based Laplacian Pyramid Method for Image Defogging , 2019, IEEE Access.

[6]  Junfeng Lei,et al.  Scene-aware image dehazing based on sky-segmented dark channel prior , 2017, IET Image Process..

[7]  Qingfeng Zhang,et al.  Improve Transmission by Designing Filters for Image Dehazing , 2018, 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC).

[8]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[9]  Hongmei Yan,et al.  Criteria to evaluate the fidelity of image enhancement by MSRCR , 2018, IET Image Process..

[10]  Alan Conrad Bovik,et al.  Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging , 2015, IEEE Transactions on Image Processing.

[11]  Dong Liu,et al.  High-Resolution Representations for Labeling Pixels and Regions , 2019, ArXiv.

[12]  Radu Timofte,et al.  O-HAZE: A Dehazing Benchmark with Real Hazy and Haze-Free Outdoor Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  Soni Chaturvedi,et al.  An Approach to Image Segmentation using K-means Clustering Algorithm , 2012 .

[14]  Khawar Khurshid,et al.  Segmentation-based image defogging using modified dark channel prior , 2020, EURASIP J. Image Video Process..

[15]  Ling Shao,et al.  Single Image Dehazing Based on the Physical Model and MSRCR Algorithm , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[17]  Ali Kashif Bashir,et al.  Real-time image dehazing by superpixels segmentation and guidance filter , 2020, Journal of Real-Time Image Processing.

[18]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[19]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[20]  Yunlong Liu,et al.  Dehazing for images with large sky region , 2017, Neurocomputing.

[21]  Vijay Kumar,et al.  A Comprehensive Review of Computational Dehazing Techniques , 2018, Archives of Computational Methods in Engineering.

[22]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Dong Yang,et al.  Proximal Dehaze-Net: A Prior Learning-Based Deep Network for Single Image Dehazing , 2018, ECCV.

[24]  Kishor Sarawadekar,et al.  Single Image Dehazing using Adaptive Gamma Correction Method , 2019, TENCON 2019 - 2019 IEEE Region 10 Conference (TENCON).