Color and sharpness assessment of single image dehazing

Image dehazing is the process of enhancing a color image of a natural scene that contains an undesirable veil of fog for visualization or as a pre-processing step for computer vision systems. In this work, we investigate the performances of eleven state-of-the-art image quality metrics in evaluating dehazed images, and discuss challenges in designing an efficient dehazing evaluation metric. This is done through a composite study based on the agreement between subjective and objective evaluations. Accordingly, we evaluate five state-of-the-art dehazing algorithms. We use two semi-indoor scenes, degraded with several levels of fog. One important aspect of these scenes is that the fog-free images are available and can therefore serve as ground-truth data for dehazing methods evaluation. This study shows that the best working dehazing method depends on the density of fog. There seems to be a clear distinction between what people perceive as good quality in terms of color restoration and in terms of sharpness restoration. Most metrics show limitations in providing proper quality prediction of dehazing. According to the introduction and analysis, a contribution of this work is to point out the flaws in the evaluation and development of dehazing methods. Our observations might be considered when designing efficient methods and metrics dedicated to image dehazing.

[1]  Zhenyang Wu,et al.  Natural color image enhancement and evaluation algorithm based on human visual system , 2006, Comput. Vis. Image Underst..

[2]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[3]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[4]  Yadong Wu,et al.  Single Image Dehazing Combining Physics Model based and Non-physics Model based Methods , 2013 .

[5]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[6]  Zheng Guo,et al.  Improved single image dehazing using guided filter , 2011 .

[7]  Shree K. Nayar,et al.  Vision in bad weather , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[9]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[10]  S. I. Padma,et al.  Haze Removal of Secure Remote Surveillance System , 2013 .

[11]  Jon Y. Hardeberg,et al.  Fog removal algorithms: Survey and perceptual evaluation , 2013, European Workshop on Visual Information Processing (EUVIP).

[12]  Zhiyuan Xu,et al.  Fog Removal from Color Images using Contrast Limited Adaptive Histogram Equalization , 2009, 2009 2nd International Congress on Image and Signal Processing.

[13]  B L Sopori Broadband very low reflectance surface. , 1988, Applied optics.

[14]  D. Chandler Seven Challenges in Image Quality Assessment: Past, Present, and Future Research , 2013 .

[15]  Ruizhong Rao,et al.  Image quality assessment on image haze removal , 2011, 2011 Chinese Control and Decision Conference (CCDC).

[16]  Mark Dougherty,et al.  Road and traffic sign detection and recognition , 2005 .

[17]  Javier Vazquez-Corral,et al.  A Variational Framework for Single Image Dehazing , 2014, ECCV Workshops.

[18]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[19]  J. Iqbal,et al.  Single image haze removal using improved dark channel prior , 2013, 2013 5th International Conference on Modelling, Identification and Control (ICMIC).

[20]  Shree K. Nayar,et al.  Chromatic framework for vision in bad weather , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[21]  Silvia Silva da Costa Botelho,et al.  Transmission Estimation in Underwater Single Images , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[22]  Huimin Lu,et al.  Single image dehazing through improved atmospheric light estimation , 2015, Multimedia Tools and Applications.

[23]  Xuefeng Li,et al.  Confidence intervals for two sample binomial distribution , 2005 .

[24]  S. C. F. Lin,et al.  Dark channel prior based image de-hazing: A review , 2015, 2015 5th International Conference on Information Science and Technology (ICIST).

[25]  唐琎,et al.  Objective measurement for image defogging algorithms , 2014 .

[26]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[27]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[28]  Marius Pedersen,et al.  QuickEval: a web application for psychometric scaling experiments , 2015, Electronic Imaging.

[29]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[30]  G. Dhivyasri,et al.  Underwater image enhancement by dark channel prior , 2015, 2015 2nd International Conference on Electronics and Communication Systems (ICECS).

[31]  Philipp Urban,et al.  Evaluating the multi-scale iCID metric , 2015, Electronic Imaging.

[32]  Yonghong Tian,et al.  Quality Assessment for Comparing Image Enhancement Algorithms , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Zhou Wang,et al.  Perceptual evaluation of single image dehazing algorithms , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[34]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[35]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[36]  Alan Conrad Bovik,et al.  Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging , 2015, IEEE Transactions on Image Processing.

[37]  Javier Vazquez-Corral,et al.  Enhanced Variational Image Dehazing , 2015, SIAM J. Imaging Sci..

[38]  Niklas Pettersson GPU-Accelerated Real-Time Surveillance De-Weathering , 2013 .

[39]  Huib de Ridder,et al.  Perceptually optimal color reproduction , 1998, Electronic Imaging.

[40]  Yunlong Liu,et al.  Dehazing for images with large sky region , 2017, Neurocomputing.

[41]  Christophe De Vleeschouwer,et al.  D-HAZY: A dataset to evaluate quantitatively dehazing algorithms , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[42]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Bo Wu,et al.  Improved single image dehazing using dark channel prior , 2010, 2010 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[44]  Ingmar Lissner,et al.  Image-Difference Prediction: From Grayscale to Color , 2013, IEEE Transactions on Image Processing.

[45]  Ric,et al.  BLIND CONTRAST ENHANCEMENT ASSESSMENT BY GRADIENT RATIOING AT VISIBLE EDGES , 2008 .

[46]  Leida Li,et al.  Blind Quality Assessment of Dehazed Images by Analyzing Information, Contrast, and Luminance , 2017, J. Netw. Intell..

[47]  2013 Ieee International Conference on Computer Vision , 2022 .

[48]  Hongyu Li,et al.  VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment , 2014, IEEE Transactions on Image Processing.

[49]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Philipp Urban,et al.  Image-Difference Prediction: From Color to Spectral , 2014, IEEE Transactions on Image Processing.

[51]  Martin Kleinsteuber,et al.  A RGB/NIR Data Set For Evaluating Dehazing Algorithms , 2017 .

[52]  Jean-Philippe Tarel,et al.  Vision Enhancement in Homogeneous and Heterogeneous Fog , 2012, IEEE Intelligent Transportation Systems Magazine.

[53]  Jean-Baptiste Thomas,et al.  A Color Image Database for Haze Model and Dehazing Methods Evaluation , 2016, ICISP.

[54]  Rongrong Lu,et al.  Dehazed Image Quality Assessment by Haze-Line Theory , 2017 .

[55]  Jean-Baptiste Thomas,et al.  HAZE AND CONVERGENCE MODELS: EXPERIMENTAL COMPARISON , 2015 .

[56]  Qing Liu,et al.  Fast image dehazing using improved dark channel prior , 2012, 2012 IEEE International Conference on Information Science and Technology.

[57]  Ling Shao,et al.  Single Image Dehazing Using Color Attenuation Prior , 2014, BMVC.

[58]  Jean-Baptiste Thomas,et al.  Does Dehazing Model Preserve Color Information? , 2014, 2014 Tenth International Conference on Signal-Image Technology and Internet-Based Systems.

[59]  Weixin Xie,et al.  Patch-Based Dark Channel Prior Dehazing for RS Multi-spectral Image , 2015 .

[60]  Wei Sun,et al.  A new single-image fog removal algorithm based on physical model , 2013 .