Single Underwater Image Enhancement Based on $L_{P}$ -Norm Decomposition

Integration of ocean monitoring networks with artificial intelligence has become a popular topic for researchers. Artificial intelligence plays an important role in underwater image processing. For optical images captured in an underwater environment, the light scattering and absorption effect caused by the water medium results in poor visibility, such as blur and color casts. A novel approach is proposed herein to enhance the single underwater image with poor visibility. Similar to other image enhancement strategies built on fusion principles, our method also generates two input channels from the original degraded image, and these two channels are modulated by their corresponding weight measures. However, the main innovation of our method is that we propose a new multilevel decomposition approach based on <inline-formula> <tex-math notation="LaTeX">$l_{p}$ </tex-math></inline-formula>-norm <inline-formula> <tex-math notation="LaTeX">$(p=0, 1, 2)$ </tex-math></inline-formula> decomposition. According to the different sparse representation abilities of <inline-formula> <tex-math notation="LaTeX">$l_{p}$ </tex-math></inline-formula>-norm to an image’s spatial information, our approach decomposes the image into three levels: detail level, structure level, and illuminance level. Thus, these three levels can be manipulated separately. Because this new decomposition approach is based on image structural contents, rather than direct per-pixel downsampling that is utilized in traditional multi-resolution pyramid decomposition, it is more accurate and flexible. Additionally, according to specific underwater imaging conditions, we carefully select two input channels and their three associated global contrast, local contrast, and saliency weight measures. Our method generates output with more accurate details and a better illuminant dynamic range. Generally, we are the first to impose an <inline-formula> <tex-math notation="LaTeX">$l_{p}$ </tex-math></inline-formula>-norm-based decomposition strategy on underwater image restoration and enhancement. Extensive qualitative and quantitative evaluations demonstrate that our strategy yields better results than state-of-the-art algorithms.

[1]  Donna M. Kocak,et al.  A Focus on Recent Developments and Trends in Underwater Imaging , 2008 .

[2]  Lei Zhang,et al.  Learning Converged Propagations With Deep Prior Ensemble for Image Enhancement , 2018, IEEE Transactions on Image Processing.

[3]  David Zhang,et al.  A Hybrid l1-l0 Layer Decomposition Model for Tone Mapping , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Christophe De Vleeschouwer,et al.  Night-time dehazing by fusion , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[5]  Andrea Cavallaro,et al.  Hierarchical rank-based veiling light estimation for underwater dehazing , 2015, BMVC.

[6]  Wenjun Zhang,et al.  Automatic Contrast Enhancement Technology With Saliency Preservation , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[8]  Yoav Y. Schechner,et al.  Regularized Image Recovery in Scattering Media , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Yanning Zhang,et al.  Single Image Super-resolution Using Deformable Patches , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Soo-Chang Pei,et al.  Nighttime haze removal using color transfer pre-processing and Dark Channel Prior , 2012, 2012 19th IEEE International Conference on Image Processing.

[11]  Ying-Ching Chen,et al.  Underwater Image Enhancement by Wavelength Compensation and Dehazing , 2012, IEEE Transactions on Image Processing.

[12]  Jules S. Jaffe,et al.  Computer modeling and the design of optimal underwater imaging systems , 1990 .

[13]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[14]  Truong Q. Nguyen,et al.  On the effectiveness of the Dark Channel Prior for single image dehazing by approximating with minimum volume ellipsoids , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[16]  Xuelong Li,et al.  Image Super-Resolution With Sparse Neighbor Embedding , 2012, IEEE Transactions on Image Processing.

[17]  Ke Gu,et al.  Learning a No-Reference Quality Assessment Model of Enhanced Images With Big Data , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Younggun Cho,et al.  Visibility enhancement for underwater visual SLAM based on underwater light scattering model , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, ECCV.

[20]  Zhuo Xu,et al.  Underwater computational ghost imaging. , 2017, Optics express.

[21]  Matthew Johnson-Roberson,et al.  Underwater Image Dehazing with a Light Field Camera , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[22]  Shih-Chia Huang,et al.  Visibility Restoration of Single Hazy Images Captured in Real-World Weather Conditions , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Chen Feng,et al.  Near-infrared guided color image dehazing , 2013, 2013 IEEE International Conference on Image Processing.

[24]  Hairong Qi,et al.  Image Super-Resolution by Neural Texture Transfer , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Silvia Silva da Costa Botelho,et al.  Transmission Estimation in Underwater Single Images , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[26]  Zhou Wang,et al.  No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene Statistics , 2015, IEEE Signal Processing Letters.

[27]  Tian Pu,et al.  Contrast-based image fusion using the discrete wavelet transform , 2000 .

[28]  Huimin Lu,et al.  Underwater Image Super-Resolution by Descattering and Fusion , 2017, IEEE Access.

[29]  Dani Lischinski,et al.  Deep photo: model-based photograph enhancement and viewing , 2008, SIGGRAPH 2008.

[30]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[31]  Weisi Lin,et al.  The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement , 2016, IEEE Transactions on Cybernetics.

[32]  B. L. McGlamery,et al.  A Computer Model For Underwater Camera Systems , 1980, Other Conferences.

[33]  G. Seet,et al.  Divergent-beam Lidar imaging in turbid water , 2004 .

[34]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[35]  Codruta O. Ancuti,et al.  Enhancing underwater images and videos by fusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Nicolai Petkov,et al.  Contour and boundary detection improved by surround suppression of texture edges , 2004, Image Vis. Comput..

[37]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[38]  David J. Kriegman,et al.  Photometric Stereo in a Scattering Medium , 2015, ICCV.

[39]  Huimin Lu,et al.  Contrast enhancement for images in turbid water. , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[40]  Ko Nishino,et al.  Bayesian Defogging , 2012, International Journal of Computer Vision.

[41]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Stefan B. Williams,et al.  Linear Volumetric Focus for Light Field Cameras , 2015, TOGS.

[43]  Timothy Binkley,et al.  Art and Visual Perception: The New Version , 1976 .

[44]  Adrian Galdran,et al.  Automatic Red-Channel underwater image restoration , 2015, J. Vis. Commun. Image Represent..

[45]  John W. Fisher,et al.  Bayesian Nonparametric Intrinsic Image Decomposition , 2014, ECCV.

[46]  Emma Pickwell-MacPherson,et al.  Calibration method to improve the accuracy of THz imaging and spectroscopy in reflection geometry , 2016 .

[47]  Maria E. Angelopoulou,et al.  Effective Backscatter Approximation for Photometry in Murky Water , 2016, ArXiv.

[48]  Minh N. Do,et al.  Robust Image and Video Dehazing with Visual Artifact Suppression via Gradient Residual Minimization , 2016, ECCV.

[49]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[50]  Yizhou Yu,et al.  An L1 image transform for edge-preserving smoothing and scene-level intrinsic decomposition , 2015, ACM Trans. Graph..

[51]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[52]  Alan L. Yuille,et al.  Learning a dictionary of deformable patches using GPUs , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[53]  Codruta O. Ancuti,et al.  Color Balance and Fusion for Underwater Image Enhancement , 2018, IEEE Transactions on Image Processing.

[54]  Hans Israël,et al.  KOSCHMIEDERs Theorie der horizontalen Sichtweite , 1959 .