Band Selection for Dehazing Algorithms Applied to Hyperspectral Images in the Visible Range

Images captured under bad weather conditions (e.g., fog, haze, mist, dust, etc.), suffer from poor contrast and visibility, and color distortions. The severity of this degradation depends on the distance, the density of the atmospheric particles and the wavelength. We analyzed eight single image dehazing algorithms representative of different strategies and originally developed for RGB images, over a database of hazy spectral images in the visible range. We carried out a brute force search to find the optimum three wavelengths according to a new combined image quality metric. The optimal triplet of monochromatic bands depends on the dehazing algorithm used and, in most cases, the different bands are quite close to each other. According to our proposed combined metric, the best method is the artificial multiple exposure image fusion (AMEF). If all wavelengths within the range 450–720 nm are used to build a sRGB renderization of the imagaes, the two best-performing methods are AMEF and the contrast limited adaptive histogram equalization (CLAHE), with very similar quality of the dehazed images. Our results show that the performance of the algorithms critically depends on the signal balance and the information present in the three channels of the input image. The capture time can be considerably shortened, and the capture device simplified by using a triplet of bands instead of the full wavelength range for dehazing purposes, although the selection of the bands must be performed specifically for a given algorithm.

[1]  Jean-Baptiste Thomas,et al.  Comparison of Imaging Models for Spectral Unmixing in Oil Painting † , 2021, Sensors.

[2]  Nicolas Hautière,et al.  Contrast restoration of road images taken in foggy weather , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[3]  David S. Doermann,et al.  Unsupervised feature learning framework for no-reference image quality assessment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Adrian Galdran,et al.  Image dehazing by artificial multiple-exposure image fusion , 2018, Signal Process..

[5]  Radu Timofte,et al.  O-HAZE: A Dehazing Benchmark with Real Hazy and Haze-Free Outdoor Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[6]  Zhu Rong,et al.  Improved wavelet transform algorithm for single image dehazing , 2014 .

[7]  Michael S. Brown,et al.  Haze Visibility Enhancement: A Survey and Quantitative Benchmarking , 2016, Comput. Vis. Image Underst..

[8]  Matthew Anderson,et al.  Proposal for a Standard Default Color Space for the Internet - sRGB , 1996, CIC.

[9]  Ian D. Reid,et al.  Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Alan Conrad Bovik,et al.  Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging , 2015, IEEE Transactions on Image Processing.

[11]  Jean-Baptiste Thomas,et al.  Color and sharpness assessment of single image dehazing , 2017, Multimedia Tools and Applications.

[12]  Wenhan Luo,et al.  Single Image Dehazing via Dual-Path Recurrent Network , 2021, IEEE Transactions on Image Processing.

[13]  Christophe De Vleeschouwer,et al.  D-HAZY: A dataset to evaluate quantitatively dehazing algorithms , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[14]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Gaurav Sharma,et al.  HazeRD: An outdoor scene dataset and benchmark for single image dehazing , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[16]  Xiaohui Yuan,et al.  Recent advances in image dehazing , 2017, IEEE/CAA Journal of Automatica Sinica.

[17]  Jean-Philippe Tarel,et al.  BLIND CONTRAST ENHANCEMENT ASSESSMENT BY GRADIENT RATIOING AT VISIBLE EDGES , 2011 .

[18]  Javier Hernández-Andrés,et al.  Sensor‐response‐ratio constancy under changes in natural and artificial illuminants , 2007 .

[19]  J. Alex Stark,et al.  Adaptive image contrast enhancement using generalizations of histogram equalization , 2000, IEEE Trans. Image Process..

[20]  Aryan Mehra,et al.  ReViewNet: A Fast and Resource Optimized Network for Enabling Safe Autonomous Driving in Hazy Weather Conditions , 2021, IEEE Transactions on Intelligent Transportation Systems.

[21]  Shree K. Nayar,et al.  All the Images of an Outdoor Scene , 2002, ECCV.

[22]  Sergiu Nedevschi,et al.  Exponential Contrast Restoration in Fog Conditions for Driving Assistance , 2015, IEEE Transactions on Intelligent Transportation Systems.

[23]  Martin Kleinsteuber,et al.  A RGB/NIR Data Set For Evaluating Dehazing Algorithms , 2017 .

[24]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[25]  Zhou Wang,et al.  Perceptual evaluation of single image dehazing algorithms , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[26]  Don H. Johnson,et al.  Signal-to-noise ratio , 2006, Scholarpedia.

[27]  Changxin Gao,et al.  Domain Adaptation for Image Dehazing , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Jean-Philippe Tarel,et al.  Improved visibility of road scene images under heterogeneous fog , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[29]  Philipp Urban,et al.  Color-Image Quality Assessment: From Prediction to Optimization , 2014, IEEE Transactions on Image Processing.

[30]  A. Cantor Optics of the atmosphere--Scattering by molecules and particles , 1978, IEEE Journal of Quantum Electronics.

[31]  Zhou Wang,et al.  Why is image quality assessment so difficult? , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[32]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[33]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[34]  R. F. Woolson Wilcoxon Signed-Rank Test , 2008 .

[35]  ChangCheng Wu,et al.  Research About Using the Retinex-Based Method to Remove the Fog from the Road Traffic Video , 2013 .

[36]  R.S. Kamathe,et al.  Quantification of retinex in enhancement of weather degraded images , 2008, 2008 International Conference on Audio, Language and Image Processing.

[37]  Ziyou Xiong,et al.  A two-step approach to see-through bad weather for surveillance video quality enhancement , 2011, ICRA.

[38]  Rui Yang,et al.  Gradient Information-Orientated Colour-Line Priori Knowledge for Remote Sensing Images Dehazing , 2020 .

[39]  Javier Romero,et al.  Chromatic Losses in Natural Scenes with Viewing Distance , 2014 .

[40]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[41]  Dengyin Zhang,et al.  IDE: Image Dehazing and Exposure Using an Enhanced Atmospheric Scattering Model , 2021, IEEE Transactions on Image Processing.

[42]  Javier Hernández-Andrés,et al.  Single Image Dehazing Algorithm Analysis with Hyperspectral Images in the Visible Range , 2020, Sensors.

[43]  Limin Jia,et al.  Haze Removal of Railway Monitoring Images Using Multi-Scale Residual Network , 2021, IEEE Transactions on Intelligent Transportation Systems.

[44]  Zhiyuan Xu,et al.  Fog Removal from Color Images using Contrast Limited Adaptive Histogram Equalization , 2009, 2009 2nd International Congress on Image and Signal Processing.

[45]  Flavio Piccoli,et al.  High-Resolution Single Image Dehazing Using Encoder-Decoder Architecture , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[46]  C. Bohren,et al.  An introduction to atmospheric radiation , 1981 .

[47]  Jean-Baptiste Thomas,et al.  A Color Image Database for Haze Model and Dehazing Methods Evaluation , 2016, ICISP.

[48]  Jean-Philippe Tarel,et al.  Vision Enhancement in Homogeneous and Heterogeneous Fog , 2012, IEEE Intelligent Transportation Systems Magazine.

[49]  Yucel Cimtay,et al.  Smart and real-time image dehazing on mobile devices , 2021, Journal of Real-Time Image Processing.

[50]  Xin Zhao,et al.  Single image dehazing based on fusion strategy , 2020, Neurocomputing.

[51]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[52]  Can Ding,et al.  IDGCP: Image Dehazing Based on Gamma Correction Prior , 2020, IEEE Transactions on Image Processing.

[53]  R. Pincus A First Course on Atmospheric Radiation , 2004 .

[54]  Srimanta Mandal,et al.  Multilevel weighted enhancement for underwater image dehazing. , 2019, Journal of the Optical Society of America. A, Optics, image science, and vision.

[55]  Sérgio M. C. Nascimento,et al.  Near perfect visual compensation for atmospheric color distortions , 2020 .

[56]  Peter Reinartz,et al.  Haze Detection and Removal in Remotely Sensed Multispectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[57]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[58]  Jessica El khoury Model and quality assessment of single image dehazing , 2016 .

[59]  Pheng-Ann Heng,et al.  Deep Multi-Model Fusion for Single-Image Dehazing , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[60]  Dan Feng,et al.  Benchmarking Single-Image Dehazing and Beyond , 2017, IEEE Transactions on Image Processing.

[61]  Luc Van Gool,et al.  Model Adaptation with Synthetic and Real Data for Semantic Dense Foggy Scene Understanding , 2018, ECCV.

[62]  Vinay K. Pathak,et al.  An Efficient Deblurring Algorithm on Foggy Images using Curvelet Transforms , 2015, WCI '15.

[63]  S. Nascimento,et al.  The number of discernible colors in natural scenes. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[64]  Radu Timofte,et al.  I-HAZE: a dehazing benchmark with real hazy and haze-free indoor images , 2018, ACIVS.

[65]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[66]  Ingmar Lissner,et al.  Image-Difference Prediction: From Grayscale to Color , 2013, IEEE Transactions on Image Processing.

[67]  Zhiyuan Xu,et al.  Fog Removal from Video Sequences Using Contrast Limited Adaptive Histogram Equalization , 2009, 2009 International Conference on Computational Intelligence and Software Engineering.

[68]  Radu Timofte,et al.  Dense-Haze: A Benchmark for Image Dehazing with Dense-Haze and Haze-Free Images , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[69]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[70]  Radu Timofte,et al.  NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Images , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[71]  John P. Oakley,et al.  Improving image quality in poor visibility conditions using a physical model for contrast degradation , 1998, IEEE Trans. Image Process..

[72]  Chen Feng,et al.  Near-infrared guided color image dehazing , 2013, 2013 IEEE International Conference on Image Processing.

[73]  Shree K. Nayar,et al.  Chromatic framework for vision in bad weather , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[74]  Ruizhong Rao,et al.  Image quality assessment on image haze removal , 2011, 2011 Chinese Control and Decision Conference (CCDC).

[75]  Hongyu Li,et al.  VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment , 2014, IEEE Transactions on Image Processing.

[76]  Javier Romero,et al.  Recovering of weather degraded images based on RGB response ratio constancy. , 2015, Applied optics.

[77]  Yunlong Liu,et al.  Dehazing for images with large sky region , 2017, Neurocomputing.

[78]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[79]  Zixing Cai,et al.  Objective measurement for image defogging algorithms , 2014 .

[80]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[81]  Jean-Baptiste Thomas,et al.  A Spectral Hazy Image Database , 2020, ICISP.

[82]  Xiaoqin Zhang,et al.  Pyramid Channel-based Feature Attention Network for image dehazing , 2020, Comput. Vis. Image Underst..

[83]  Ranko Petrović,et al.  Enhancement Algorithms for Low-Light and Low-Contrast Images , 2020, 2020 19th International Symposium INFOTEH-JAHORINA (INFOTEH).

[84]  Ling Shi,et al.  Hyperspectral face recognition based on sparse spectral attention deep neural networks. , 2020, Optics express.

[85]  Ayman Alfalou,et al.  Adaptation of Koschmieder dehazing model for underwater marker detection , 2020, Defense + Commercial Sensing.

[86]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[87]  Ali Kashif Bashir,et al.  Real-time image dehazing by superpixels segmentation and guidance filter , 2020, Journal of Real-Time Image Processing.