Underwater Image Enhancement Based on Global and Local Equalization of Histogram and Dual-Image Multi-Scale Fusion

Underwater images suffer from color cast and low visibility caused by the medium scattering and absorption, which will reduce the use of valuable information from the image. In this paper, we propose a novel method which includes four stages of pixel intensity center regionalization, global equalization of histogram, local equalization of histogram and multi-scale fusion. Additionally, this method uses a pixel intensity center regionalization strategy to perform centralization of the image histogram on the overall image. Global equalization of histogram is employed to correct color of the image according to the characteristics of each channel. Local equalization of dual-interval histogram based on average of peak and mean values is used to improve contrast of the image according to the characteristics of each channel. Dual-image multi-scale fusion to integrate the contrast, saliency and exposure weight maps of the color corrected and contrast enhanced images. Experiments on variety types of degraded underwater images show that the proposed method produces better output results in both qualitative and quantitative analysis, thus, the proposed method outperforms other state-of-the-art methods.

[1]  Lap-Pui Chau,et al.  Single Underwater Image Restoration Using Adaptive Attenuation-Curve Prior , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[2]  Zhenyu Wu,et al.  All-In-One Underwater Image Enhancement using Domain-Adversarial Learning , 2019, CVPR Workshops.

[3]  Nor Ashidi Mat Isa,et al.  Underwater image quality enhancement through integrated color model with Rayleigh distribution , 2015, Appl. Soft Comput..

[4]  Pamela C. Cosman,et al.  Underwater Image Restoration Based on Image Blurriness and Light Absorption , 2017, IEEE Transactions on Image Processing.

[5]  Chunle Guo,et al.  Emerging From Water: Underwater Image Color Correction Based on Weakly Supervised Color Transfer , 2017, IEEE Signal Processing Letters.

[6]  Yoav Y. Schechner,et al.  Active Polarization Descattering , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Shai Avidan,et al.  Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Dacheng Tao,et al.  An Underwater Image Enhancement Benchmark Dataset and Beyond , 2019, IEEE Transactions on Image Processing.

[9]  Zhenbing Liu,et al.  MADNet: A Fast and Lightweight Network for Single-Image Super Resolution , 2020, IEEE Transactions on Cybernetics.

[10]  Ke Hu,et al.  An In-Depth Survey of Underwater Image Enhancement and Restoration , 2019, IEEE Access.

[11]  Xiaochun Cao,et al.  Deep Video Dehazing With Semantic Segmentation , 2019, IEEE Transactions on Image Processing.

[12]  Codruta O. Ancuti,et al.  Fusion-based restoration of the underwater images , 2011, 2011 18th IEEE International Conference on Image Processing.

[13]  Runmin Cong,et al.  A hybrid method for underwater image correction , 2017, Pattern Recognit. Lett..

[14]  Anne E. James,et al.  Enhancing the low quality images using Unsupervised Colour Correction Method , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[15]  Xiaochun Cao,et al.  Accurate Transmission Estimation for Removing Haze and Noise From a Single Image , 2019, IEEE Transactions on Image Processing.

[16]  Nor Ashidi Mat Isa,et al.  Automatic system for improving underwater image contrast and color through recursive adaptive histogram modification , 2017, Comput. Electron. Agric..

[17]  Zhenbing Liu,et al.  Accurate segmentation of nuclei in pathological images via sparse reconstruction and deep convolutional networks , 2017, Neurocomputing.

[18]  Ming Zhu,et al.  Real-World Underwater Enhancement: Challenges, Benchmarks, and Solutions Under Natural Light , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[20]  Yafei Wang,et al.  Single underwater image enhancement by attenuation map guided color correction and detail preserved dehazing , 2020, Neurocomputing.

[21]  Alvarez-GilaAitor,et al.  Automatic Red-Channel underwater image restoration , 2015 .

[22]  Zuwairie Ibrahim,et al.  Natural-based underwater image color enhancement through fusion of swarm-intelligence algorithm , 2019, Appl. Soft Comput..

[23]  Runmin Cong,et al.  Underwater Image Enhancement by Dehazing With Minimum Information Loss and Histogram Distribution Prior , 2016, IEEE Transactions on Image Processing.

[24]  Ahmad Shahrizan Abdul Ghani,et al.  Image contrast enhancement using an integration of recursive-overlapped contrast limited adaptive histogram specification and dual-image wavelet fusion for the high visibility of deep underwater image , 2018 .

[25]  Fatih Murat Porikli,et al.  Underwater scene prior inspired deep underwater image and video enhancement , 2020, Pattern Recognit..

[26]  Tie Qiu,et al.  A Review on Intelligence Dehazing and Color Restoration for Underwater Images , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[27]  Mateu Sbert,et al.  Color Channel Compensation (3C): A Fundamental Pre-Processing Step for Image Enhancement , 2019, IEEE Transactions on Image Processing.

[28]  Arcot Sowmya,et al.  An Underwater Color Image Quality Evaluation Metric , 2015, IEEE Transactions on Image Processing.

[29]  Jie Li,et al.  WaterGAN: Unsupervised Generative Network to Enable Real-Time Color Correction of Monocular Underwater Images , 2017, IEEE Robotics and Automation Letters.

[30]  Li Qin,et al.  Single Image Defogging Based on Multi-Channel Convolutional MSRCR , 2019, IEEE Access.

[31]  Ying-Ching Chen,et al.  Underwater Image Enhancement by Wavelength Compensation and Dehazing , 2012, IEEE Transactions on Image Processing.

[32]  Yong-Jie Li,et al.  Underwater Image Enhancement Using Adaptive Retinal Mechanisms , 2019, IEEE Transactions on Image Processing.

[33]  Tiegen Liu,et al.  Underwater image recovery considering polarization effects of objects. , 2016, Optics express.

[34]  Huimin Lu,et al.  Underwater Image Super-Resolution by Descattering and Fusion , 2017, IEEE Access.

[35]  Yu Wang,et al.  Efficient underwater image and video enhancement based on Retinex , 2019, Signal Image Video Process..

[36]  Delu Zeng,et al.  A fusion-based enhancing method for weakly illuminated images , 2016, Signal Process..

[37]  Xinghao Ding,et al.  Two-step approach for single underwater image enhancement , 2017, 2017 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[38]  Nor Ashidi Mat Isa,et al.  Enhancement of low quality underwater image through integrated global and local contrast correction , 2015, Appl. Soft Comput..

[39]  Codruta O. Ancuti,et al.  Color Balance and Fusion for Underwater Image Enhancement , 2018, IEEE Transactions on Image Processing.

[40]  Mario Fernando Montenegro Campos,et al.  Underwater Depth Estimation and Image Restoration Based on Single Images , 2016, IEEE Computer Graphics and Applications.

[41]  Derya Akkaynak,et al.  Sea-Thru: A Method for Removing Water From Underwater Images , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Junping Du,et al.  Low-Light Image Enhancement via a Deep Hybrid Network , 2019, IEEE Transactions on Image Processing.

[43]  Zhou Wang,et al.  A Patch-Structure Representation Method for Quality Assessment of Contrast Changed Images , 2015, IEEE Signal Processing Letters.

[44]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Yoav Y. Schechner,et al.  Turbid Scene Enhancement Using Multi-Directional Illumination Fusion , 2012, IEEE Transactions on Image Processing.

[46]  Pamela C. Cosman,et al.  Generalization of the Dark Channel Prior for Single Image Restoration , 2018, IEEE Transactions on Image Processing.

[47]  Jian-Ru Lin,et al.  Underwater image enhancement method using weighted guided trigonometric filtering and artificial light correction , 2016, J. Vis. Commun. Image Represent..

[48]  Chongyi Li,et al.  Diving Deeper into Underwater Image Enhancement: A Survey , 2019, Signal Process. Image Commun..

[49]  Takayuki Hamamoto,et al.  Underwater Image Color Correction using Exposure-Bracketing Imaging , 2018, IEEE Signal Processing Letters.

[50]  Xiao-Ping Zhang,et al.  A retinex-based enhancing approach for single underwater image , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[51]  Joze Guna,et al.  Preface: Optical Imaging for Extreme Environment , 2019 .

[52]  Li Qin,et al.  A Survey of Restoration and Enhancement for Underwater Images , 2019, IEEE Access.

[53]  Yuan Zhou,et al.  Underwater Image Restoration Using Color-Line Model , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[54]  Cosmin Ancuti,et al.  Color Channel Transfer for Image Dehazing , 2019, IEEE Signal Processing Letters.

[55]  Hanyu Li,et al.  Underwater Image Enhancement Using a Multiscale Dense Generative Adversarial Network , 2020, IEEE Journal of Oceanic Engineering.

[56]  Ayman Alfalou,et al.  Enhancing underwater optical imaging by using a low-pass polarization filter. , 2019, Optics express.

[57]  Li Wen,et al.  Towards Real-Time Advancement of Underwater Visual Quality With GAN , 2017, IEEE Transactions on Industrial Electronics.

[58]  Bing Zheng,et al.  Offshore Underwater Image Restoration Using Reflection-Decomposition-Based Transmission Map Estimation , 2020, IEEE Journal of Oceanic Engineering.

[59]  Huimin Lu,et al.  Contrast enhancement for images in turbid water. , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[60]  Codruta O. Ancuti,et al.  Enhancing underwater images and videos by fusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[61]  Ting Wang,et al.  Underwater image enhancement via extended multi-scale Retinex , 2017, Neurocomputing.

[62]  Sam Kwong,et al.  Nested Network With Two-Stream Pyramid for Salient Object Detection in Optical Remote Sensing Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.