A survey on analysis and implementation of state-of-the-art haze removal techniques

Abstract Haze is a poor-quality state described by the opalescent appearance of the atmosphere which reduces the visibility. It is caused by high concentrations of atmospheric air pollutants, such as dust, smoke and other particles that scatter and absorb sunlight. The poor visibility can result in the failure of multiple computer vision applications such as smart transport systems, image processing, object detection, surveillance etc. One of the major issues in the field of image processing is the restoration of images that are corrupted due to different degradations. Typically, the images or videos captured in the outside environment have low contrast, colour fade and restricted visibility due to suspended particles of the atmosphere that directly influence the image quality. This can cause difficulty in identifying the objects in the captured hazy images or frames. To address this problem, several image dehazing techniques have been developed in the literature, each of which has its own advantages and limitations, but effective image restoration remains a challenging task. In recent times, various learning (Machine learning & Deep learning) based methods greatly condensed the drawbacks of manual design of haze related features and reduces the difficulty in efficient restoration of images with less computational time and cost. The current state-of-the-art methods for haze free images, mainly from the last decade, are thoroughly examined in this survey. Moreover, this paper systematically summarizes the hardware implementations of various haze removal methods in real time. It is with the hope that this current survey acts as a reference for researchers in this scientific area and to provide a direction for future improvements based on current achievements.

[1]  Fan Guo,et al.  Genetic algorithm-based parameter selection approach to single image defogging , 2016, Inf. Process. Lett..

[2]  Yunlong Liu,et al.  Fast Image Dehazing Method Based on Linear Transformation , 2017, IEEE Transactions on Multimedia.

[3]  Wonha Kim,et al.  Single Image Dehazing Using Color Ellipsoid Prior , 2018, IEEE Transactions on Image Processing.

[4]  Changchun Liu,et al.  A Region-Wised Medium Transmission Based Image Dehazing Method , 2017, IEEE Access.

[5]  Srikanth Vasamsetti,et al.  Wavelet based perspective on variational enhancement technique for underwater imagery , 2017 .

[6]  Vijay Kumar,et al.  Modified gain intervention filter based dehazing technique , 2017 .

[7]  Jun Zhang,et al.  A GPU-accelerated real-time single image de-hazing method using pixel-level optimal de-hazing criterion , 2012, Journal of Real-Time Image Processing.

[8]  Pei-Yin Chen,et al.  Hardware Implementation of a Fast and Efficient Haze Removal Method , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Zhengguo Li,et al.  Edge-Preserving Decomposition-Based Single Image Haze Removal , 2015, IEEE Transactions on Image Processing.

[10]  Wei Tang,et al.  Single Remote Sensing Image Dehazing , 2014, IEEE Geoscience and Remote Sensing Letters.

[11]  Zhu Rong,et al.  Improved wavelet transform algorithm for single image dehazing , 2014 .

[12]  Javier Vazquez-Corral,et al.  Fusion-Based Variational Image Dehazing , 2017, IEEE Signal Processing Letters.

[13]  Vijay Kumar,et al.  Comprehensive survey on haze removal techniques , 2018, Multimedia Tools and Applications.

[14]  Keyan Wang,et al.  Single Image Dehazing with a Generic Model-Agnostic Convolutional Neural Network , 2019, IEEE Signal Processing Letters.

[15]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[16]  Cheng Zhang,et al.  An effective fusion defogging approach for single sea fog image , 2016, Neurocomputing.

[17]  Li Wei,et al.  Single-image haze removal using the mean vector L2-norm of RGB image sample window , 2015 .

[18]  Hongying Zhang,et al.  Research on image dehazing algorithms based on physical model , 2011, 2011 International Conference on Multimedia Technology.

[19]  Dilbag Singh,et al.  Efficient Landsat image fusion using fuzzy and stationary discrete wavelet transform , 2017 .

[20]  Ketan Tang,et al.  Investigating Haze-Relevant Features in a Learning Framework for Image Dehazing , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Chaomin Shen,et al.  Single image dehazing and denoising with variational method , 2010, 2010 International Conference on Image Analysis and Signal Processing.

[22]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[23]  Alan Conrad Bovik,et al.  Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging , 2015, IEEE Transactions on Image Processing.

[24]  Andrea Cavallaro,et al.  Underwater image and video dehazing with pure haze region segmentation , 2017, Comput. Vis. Image Underst..

[25]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[26]  David Dagan Feng,et al.  Combined constraint for single image dehazing , 2015 .

[27]  Tao Mei,et al.  Socialized Mobile Photography: Learning to Photograph With Social Context via Mobile Devices , 2014, IEEE Transactions on Multimedia.

[28]  Ding Meng,et al.  Efficient dark channel based image dehazing using quadtrees , 2013 .

[29]  Yong Yang,et al.  Image Dehazing Based on Robust Sparse Representation , 2018, IEEE Access.

[30]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[31]  Ju Ren,et al.  Parallel Implementation and Optimization of Haze Removal Using Dark Channel Prior Based on CUDA , 2012, HiPC 2012.

[32]  Chang-Su Kim,et al.  Optimized contrast enhancement for real-time image and video dehazing , 2013, J. Vis. Commun. Image Represent..

[33]  Chang-Hwan Son,et al.  Near-Infrared Fusion via Color Regularization for Haze and Color Distortion Removals , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Yu Zhang,et al.  A Light Dual-Task Neural Network for Haze Removal , 2018, IEEE Signal Processing Letters.

[35]  Xuansheng Wang,et al.  Dehazing for Image and Video Using Guided Filter , 2012 .

[36]  Anna Wang,et al.  AIPNet: Image-to-Image Single Image Dehazing With Atmospheric Illumination Prior , 2019, IEEE Transactions on Image Processing.

[37]  Mohammad Sadegh Helfroush,et al.  HS remote sensing image restoration using fusion with MS images by EM algorithm , 2017, IET Signal Process..

[38]  Pascal Fua,et al.  Tracking Interacting Objects Optimally Using Integer Programming , 2014, ECCV.

[39]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Jizhong Zhao,et al.  Hardware Implementation for Real-Time Haze Removal , 2017, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[41]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Pascal Fua,et al.  Take your eyes off the ball: Improving ball-tracking by focusing on team play , 2014, Comput. Vis. Image Underst..

[43]  Hua Lee,et al.  An Efficient Fusion-Based Defogging , 2017, IEEE Transactions on Image Processing.

[44]  Shih-Chia Huang,et al.  Visibility Restoration of Single Hazy Images Captured in Real-World Weather Conditions , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[45]  Huimin Lu,et al.  Underwater image dehazing using joint trilateral filter , 2014, Comput. Electr. Eng..

[46]  Wen Gao,et al.  Single underwater image enhancement with a new optical model , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[47]  Shree K. Nayar,et al.  Chromatic framework for vision in bad weather , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[48]  Huimin Lu,et al.  Single image dehazing through improved atmospheric light estimation , 2015, Multimedia Tools and Applications.

[49]  Rui Li,et al.  Haze removal based on multiple scattering model with superpixel algorithm , 2016, Signal Process..

[50]  Radu Timofte,et al.  O-HAZE: A Dehazing Benchmark with Real Hazy and Haze-Free Outdoor Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[51]  Shiqian Wu,et al.  Weighted Guided Image Filtering , 2016, IEEE Transactions on Image Processing.

[52]  Shih-Chia Huang,et al.  A High-Efficiency and High-Speed Gain Intervention Refinement Filter for Haze Removal , 2016, Journal of Display Technology.

[53]  Ko Nishino,et al.  Factorizing Scene Albedo and Depth from a Single Foggy Image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[54]  Zhenwei Shi,et al.  Fast haze removal for a single remote sensing image using dark channel prior , 2012, 2012 International Conference on Computer Vision in Remote Sensing.

[55]  Seung-Won Jung,et al.  A review on dark channel prior based image dehazing algorithms , 2016, EURASIP Journal on Image and Video Processing.

[56]  Runmin Cong,et al.  A hybrid method for underwater image correction , 2017, Pattern Recognit. Lett..

[57]  Nor Ashidi Mat Isa,et al.  Automatic system for improving underwater image contrast and color through recursive adaptive histogram modification , 2017, Comput. Electron. Agric..

[58]  Pei-Yin Chen,et al.  VLSI Design of an Efficient Flicker-Free Video Defogging Method for Real-Time Applications , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[59]  Jizheng Xu,et al.  AOD-Net: All-in-One Dehazing Network , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[60]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[61]  Nicolas Hautière,et al.  Contrast restoration of road images taken in foggy weather , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[62]  Chunxia Xiao,et al.  Efficient image dehazing using boundary conditions and local contrast , 2018, Comput. Graph..

[63]  Gaurav Sharma,et al.  HazeRD: An outdoor scene dataset and benchmark for single image dehazing , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[64]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.

[65]  Rynson W. H. Lau,et al.  Fast Weighted Histograms for Bilateral Filtering and Nearest Neighbor Searching , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[66]  Qi Li,et al.  Image degradation and recovery based on multiple scattering in remote sensing and bad weather condition , 2012 .

[67]  Masatoshi Okutomi,et al.  Unified Image Fusion Framework With Learning-Based Application-Adaptive Importance Measure , 2019, IEEE Transactions on Computational Imaging.

[68]  Ying-Ching Chen,et al.  Underwater Image Enhancement by Wavelength Compensation and Dehazing , 2012, IEEE Transactions on Image Processing.

[69]  Young-Hyung Kim,et al.  FPGA Implementation for Enhancing Image Using Pixel-Based Median Channel Prior , 2015, MUE 2015.

[70]  N. Tamil Selvi,et al.  Dehazing of Natural Images using Non-Linear Wavelet Filter , 2018, 2018 Second International Conference on Green Computing and Internet of Things (ICGCIoT).

[71]  Shree K. Nayar,et al.  Instant dehazing of images using polarization , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[72]  Minh N. Do,et al.  Robust Image and Video Dehazing with Visual Artifact Suppression via Gradient Residual Minimization , 2016, ECCV.

[73]  Zahid Mehmood,et al.  Single Image Dehazing and Edge Preservation Based on the Dark Channel Probability-Weighted Moments , 2019 .

[74]  Katsushi Ikeuchi,et al.  Adherent Raindrop Detection and Removal in Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[75]  Shree K. Nayar,et al.  Polarization-based vision through haze , 2003 .

[76]  Ngaiming Kwok,et al.  Image contrast enhancement with brightness preservation using an optimal gamma correction and weighted sum approach , 2015 .

[77]  Yuan-Kai Wang,et al.  Single Image Defogging by Multiscale Depth Fusion , 2014, IEEE Transactions on Image Processing.

[78]  Shih-Chia Huang,et al.  Hazy Image Restoration by Bi-Histogram Modification , 2015, ACM Trans. Intell. Syst. Technol..

[79]  Jean-Philippe Tarel,et al.  Stereo Reconstruction and Contrast Restoration in Daytime Fog , 2012, ACCV.

[80]  Dan Wang,et al.  Fast smoothing technique with edge preservation for single image dehazing , 2015, IET Comput. Vis..

[81]  Shi-Jinn Horng,et al.  Contrast in Haze Removal: Configurable Contrast Enhancement Model Based on Dark Channel Prior , 2019, IEEE Transactions on Image Processing.

[82]  Wenbin Chen,et al.  Real-Time Dehazing for Image and Video , 2010, 2010 18th Pacific Conference on Computer Graphics and Applications.

[83]  Shree K. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[84]  Satbir Singh,et al.  A Review on Various Haze Removal Techniques for Image Processing , 2015 .

[85]  Guojia Hou,et al.  Single image dehazing and denoising combining dark channel prior and variational models , 2017, IET Comput. Vis..

[86]  Hyunchul Shin,et al.  Single image dehazing with bright object handling , 2016, IET Comput. Vis..

[87]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[88]  Vijay Kumar,et al.  A Comprehensive Review of Computational Dehazing Techniques , 2018, Archives of Computational Methods in Engineering.

[89]  Javier Vazquez-Corral,et al.  Enhanced Variational Image Dehazing , 2015, SIAM J. Imaging Sci..

[90]  Licheng Jiao,et al.  Fusion Similarity-Based Reranking for SAR Image Retrieval , 2017, IEEE Geoscience and Remote Sensing Letters.

[91]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[92]  Xiaohui Yuan,et al.  Recent advances in image dehazing , 2017, IEEE/CAA Journal of Automatica Sinica.

[93]  Zixing Cai,et al.  Improved Single Image Dehazing Using Dark Channel Prior and Multi-scale Retinex , 2010, 2010 International Conference on Intelligent System Design and Engineering Application.

[94]  Ko Nishino,et al.  Bayesian Defogging , 2012, International Journal of Computer Vision.

[95]  Raanan Fattal Single image dehazing , 2008, SIGGRAPH 2008.

[96]  Sudipta Mukhopadhyay,et al.  Removal of Fog from Images: A Review , 2012 .

[97]  Yan Feng,et al.  Fast single haze image enhancement , 2014, Comput. Electr. Eng..

[98]  Yongwei Wu,et al.  Real Time Image Haze Removal on Multi-core DSP☆ , 2015 .

[99]  Mario Ignacio Chacon Murguia,et al.  An Adaptive Neural-Fuzzy Approach for Object Detection in Dynamic Backgrounds for Surveillance Systems , 2012, IEEE Transactions on Industrial Electronics.

[100]  Jean-Philippe Tarel,et al.  Vision Enhancement in Homogeneous and Heterogeneous Fog , 2012, IEEE Intelligent Transportation Systems Magazine.

[101]  Dan Feng,et al.  Benchmarking Single-Image Dehazing and Beyond , 2017, IEEE Transactions on Image Processing.

[102]  Teng Yu,et al.  Real-time single image dehazing using block-to-pixel interpolation and adaptive dark channel prior , 2015, IET Image Process..

[103]  Hongguang Li,et al.  Haze removal for unmanned aerial vehicle aerial video based on spatial-temporal coherence optimisation , 2018, IET Image Process..

[104]  Sangkeun Lee,et al.  The single image dehazing based on efficient transmission estimation , 2013, 2013 IEEE International Conference on Consumer Electronics (ICCE).

[105]  Qingming Huang,et al.  Co-Saliency Detection for RGBD Images Based on Multi-Constraint Feature Matching and Cross Label Propagation , 2017, IEEE Transactions on Image Processing.

[106]  Radu Timofte,et al.  I-HAZE: a dehazing benchmark with real hazy and haze-free indoor images , 2018, ACIVS.

[107]  Bongsoon Kang,et al.  A 4K-Capable FPGA Implementation of Single Image Haze Removal Using Hazy Particle Maps , 2019, Applied Sciences.

[108]  Cosmin Ancuti,et al.  Effective single image dehazing by fusion , 2010, 2010 IEEE International Conference on Image Processing.

[109]  Wei Sun,et al.  A new single-image fog removal algorithm based on physical model , 2013 .

[110]  Wenbo Zhang,et al.  Estimation Algorithm of Atmospheric Light based on Ant Colony Optimization , 2017, ISMSI '17.

[111]  Dacheng Tao,et al.  Slow Feature Analysis for Human Action Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[112]  Cosmin Ancuti,et al.  A Fast Semi-inverse Approach to Detect and Remove the Haze from a Single Image , 2010, ACCV.

[113]  Xiaochun Cao,et al.  Deep Video Dehazing With Semantic Segmentation , 2019, IEEE Transactions on Image Processing.

[114]  Abdul Ghafoor,et al.  A Framework for Outdoor RGB Image Enhancement and Dehazing , 2018, IEEE Geoscience and Remote Sensing Letters.

[115]  Dani Lischinski,et al.  Deep photo: model-based photograph enhancement and viewing , 2008, SIGGRAPH 2008.

[116]  Sang Min Yoon,et al.  Visibility enhancement of fog-degraded image using adaptive total variation minimisation , 2016 .