A novel dark channel prior guided variational framework for underwater image restoration

Abstract Image captured underwater often suffers from low contrast, color distortion and noise problems, which is caused by absorbing and scattering before the light reaches the camera when traveling through water. Underwater image enhancement and restoration from a single image is known to be an ill-posed problem. To overcome these limitations, we establish an underwater total variation (UTV) model relying on underwater dark channel prior (UDCP), in which UDCP is used to estimate the transmission map. We design the data item and smooth item of the unified variational model based on the underwater image formation model. We further employ the alternating direction method of multipliers (ADMM) to accelerate the solving procedure. Numerical experiential results demonstrate that our underwater variational method obtains a good outcome on dehazing and denoising. Furthermore, compared with several other state-of-the-art algorithms, the proposed approach achieves better visual quality, which is illustrated by examples and statistics.

[1]  Jean-Philippe Tarel,et al.  BLIND CONTRAST ENHANCEMENT ASSESSMENT BY GRADIENT RATIOING AT VISIBLE EDGES , 2011 .

[2]  Runmin Cong,et al.  A hybrid method for underwater image correction , 2017, Pattern Recognit. Lett..

[3]  Zhou Wang,et al.  No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene Statistics , 2015, IEEE Signal Processing Letters.

[4]  Arcot Sowmya,et al.  An Underwater Color Image Quality Evaluation Metric , 2015, IEEE Transactions on Image Processing.

[5]  Adrian Galdran,et al.  Automatic Red-Channel underwater image restoration , 2015, J. Vis. Commun. Image Represent..

[6]  Zhenkuan Pan,et al.  Color image restoration and inpainting via multi-channel total curvature , 2018, Applied Mathematical Modelling.

[7]  Lin Zhao,et al.  Underwater Image Recovery Under the Nonuniform Optical Field Based on Polarimetric Imaging , 2018, IEEE Photonics Journal.

[8]  Hui Yu,et al.  Two-stage underwater image restoration based on a physical model , 2017, International Conference on Graphic and Image Processing.

[9]  Tieyong Zeng,et al.  Single Image Dehazing and Denoising: A Fast Variational Approach , 2014, SIAM J. Imaging Sci..

[10]  Chunle Guo,et al.  Emerging From Water: Underwater Image Color Correction Based on Weakly Supervised Color Transfer , 2017, IEEE Signal Processing Letters.

[11]  Guojia Hou,et al.  Efficient L1-based nonlocal total variational model of Retinex for image restoration , 2018, J. Electronic Imaging.

[12]  Jian-Ru Lin,et al.  Underwater image enhancement method using weighted guided trigonometric filtering and artificial light correction , 2016, J. Vis. Commun. Image Represent..

[13]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[14]  Takayuki Hamamoto,et al.  Underwater Image Color Correction using Exposure-Bracketing Imaging , 2018, IEEE Signal Processing Letters.

[15]  Jian Su,et al.  Robust palmprint recognition based on the fast variation Vese-Osher model , 2016, Neurocomputing.

[16]  Li Bai,et al.  Novel Methods for Microglia Segmentation, Feature Extraction, and Classification , 2017, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[17]  Jenq-Neng Hwang,et al.  A Feature Learning and Object Recognition Framework for Underwater Fish Images , 2016, IEEE Transactions on Image Processing.

[18]  Guodong Wang,et al.  Nonlocal active contour model for texture segmentation , 2017, Multimedia Tools and Applications.

[19]  Codruta O. Ancuti,et al.  Color Balance and Fusion for Underwater Image Enhancement , 2018, IEEE Transactions on Image Processing.

[20]  Yilong Yin,et al.  The extended marine underwater environment database and baseline evaluations , 2019, Appl. Soft Comput..

[21]  Jian Su,et al.  A novel hierarchical approach for multispectral palmprint recognition , 2015, Neurocomputing.

[22]  Jichang Guo,et al.  Underwater image enhancement by dehazing and color correction , 2015, J. Electronic Imaging.

[23]  Zhang Yi,et al.  A Fractional-Order Variational Framework for Retinex: Fractional-Order Partial Differential Equation-Based Formulation for Multi-Scale Nonlocal Contrast Enhancement with Texture Preserving , 2018, IEEE Transactions on Image Processing.

[24]  Benayad Nsiri,et al.  Underwater image processing method for fish localization and detection in submarine environment , 2016, J. Vis. Commun. Image Represent..

[25]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[26]  Li Bai,et al.  Implementation of high‐order variational models made easy for image processing , 2016 .

[27]  Lap-Pui Chau,et al.  Single Underwater Image Restoration Using Adaptive Attenuation-Curve Prior , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[28]  Wanquan Liu,et al.  Fast algorithm for color texture image inpainting using the non-local CTV model , 2015, J. Glob. Optim..

[29]  Uche Afam Nnolim,et al.  Smoothing and enhancement algorithms for underwater images based on partial differential equations , 2017, J. Electronic Imaging.

[30]  Michael K. Ng,et al.  A Total Variation Model for Retinex , 2011, SIAM J. Imaging Sci..

[31]  Mohua Zhang,et al.  Underwater Image Restoration Based on A New Underwater Image Formation Model , 2018, IEEE Access.

[32]  Wen Gao,et al.  Guided Image Contrast Enhancement Based on Retrieved Images in Cloud , 2016, IEEE Transactions on Multimedia.

[33]  Qiguang Miao,et al.  Color texture segmentation based on active contour model with multichannel nonlocal and Tikhonov regularization , 2017, Multimedia Tools and Applications.

[34]  Ying-Ching Chen,et al.  Underwater Image Enhancement by Wavelength Compensation and Dehazing , 2012, IEEE Transactions on Image Processing.

[35]  Jules S. Jaffe,et al.  Computer modeling and the design of optimal underwater imaging systems , 1990 .

[36]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Guojia Hou,et al.  An efficient nonlocal variational method with application to underwater image restoration , 2019, Neurocomputing.

[38]  Runmin Cong,et al.  Underwater Image Enhancement by Dehazing With Minimum Information Loss and Histogram Distribution Prior , 2016, IEEE Transactions on Image Processing.

[39]  Richard G. Baraniuk,et al.  Fast Alternating Direction Optimization Methods , 2014, SIAM J. Imaging Sci..

[40]  Guojia Hou,et al.  Hue preserving-based approach for underwater colour image enhancement , 2018, IET Image Process..

[41]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Xiaoqun Zhang,et al.  Retinex by Higher Order Total Variation L1\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$L^{1}$$\end{document} Decomp , 2015, Journal of Mathematical Imaging and Vision.

[43]  Pamela C. Cosman,et al.  Underwater Image Restoration Based on Image Blurriness and Light Absorption , 2017, IEEE Transactions on Image Processing.

[44]  Alan Conrad Bovik,et al.  Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging , 2015, IEEE Transactions on Image Processing.

[45]  Guojia Hou,et al.  Single image dehazing and denoising combining dark channel prior and variational models , 2017, IET Comput. Vis..

[46]  Guojia Hou,et al.  Underwater Color Image Enhancement Using Combining Schemes , 2014 .

[47]  Nan Wang,et al.  Underwater Image Restoration via Maximum Attenuation Identification , 2017, IEEE Access.

[48]  Joonki Paik,et al.  Variational framework for low-light image enhancement using optimal transmission map and combined ℓ2 and ℓ2-minimization , 2017, Signal Process. Image Commun..

[49]  Xiaolin Wu,et al.  Generalized Equalization Model for Image Enhancement , 2014, IEEE Transactions on Multimedia.

[50]  Yilong Yin,et al.  Integrating QDWD with pattern distinctness and local contrast for underwater saliency detection , 2018, J. Vis. Commun. Image Represent..

[51]  Rui Zhang,et al.  Global sparse gradient guided variational Retinex model for image enhancement , 2017, Signal Process. Image Commun..