Model-Assisted Multiband Fusion for Single Image Enhancement and Applications to Robot Vision

This paper presents a fast single image enhancement<xref ref-type="fn" rid="fn1"><sup>†</sup></xref> <fn id="fn1"><label><sup>†</sup></label><p><uri>https://github.com/irapkaist/multi-band-enhancement</uri>.</p> </fn> that is applicable regardless of channels in various environments. The main idea of the paper is combining model-based and fusion-based dehazing methods, thereby presenting balanced image enhancement while elaborating image details. The proposed method enhances both color and grayscale images without any prior information. Multiband decomposition is utilized to extract the base and detail layers for intensity and Laplacian modules. The proposed ambient map and transmission estimation for the intensity module are effective in restoring the true intensity. Adaptive nonlinear mapping functions adjust details on each residual layer. Through color-corrected reconstruction, our results demonstrate outstanding performance on various types of hazy images. The proposed method is thoroughly validated in terms of conventional image quality comparison. We also provide the evaluation at the application phase from both the semantic (segmentation) and geometric (direct odometry) vision based robotics application. The overall algorithm is presented in <uri>https://youtu.be/3Fk3kbaPkXQ</uri>.

[1]  Oisin Mac Aodha,et al.  Unsupervised Monocular Depth Estimation with Left-Right Consistency , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Michael Werman,et al.  Automatic recovery of the atmospheric light in hazy images , 2014, 2014 IEEE International Conference on Computational Photography (ICCP).

[3]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[4]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Ketan Tang,et al.  Investigating Haze-Relevant Features in a Learning Framework for Image Dehazing , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  Younggun Cho,et al.  Estimation of ambient light and transmission map with common convolutional architecture , 2016, OCEANS 2016 MTS/IEEE Monterey.

[8]  Jean-Philippe Tarel,et al.  Improved visibility of road scene images under heterogeneous fog , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[9]  Danping Zou,et al.  Simultaneous video defogging and stereo reconstruction , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Gabriela Csurka,et al.  What is a good evaluation measure for semantic segmentation? , 2013, BMVC.

[12]  Peyman Milanfar,et al.  Fast Multilayer Laplacian Enhancement , 2016, IEEE Transactions on Computational Imaging.

[13]  Chang-Su Kim,et al.  Optimized contrast enhancement for real-time image and video dehazing , 2013, J. Vis. Commun. Image Represent..

[14]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[15]  Daniel Cremers,et al.  Direct Sparse Odometry , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Younggun Cho,et al.  Visibility enhancement for underwater visual SLAM based on underwater light scattering model , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[19]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[20]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[21]  Andrew J. Davison,et al.  A benchmark for RGB-D visual odometry, 3D reconstruction and SLAM , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[23]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[24]  Alan Conrad Bovik,et al.  Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging , 2015, IEEE Transactions on Image Processing.

[25]  Raanan Fattal,et al.  Dehazing Using Color-Lines , 2014, ACM Trans. Graph..

[26]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..