Dual-Purpose Method for Underwater and Low-Light Image Enhancement via Image Layer Separation

Underwater and low-light images possess different characteristics; hence, few approaches have been exploited to jointly improve the visibility of these images. Herein, a dual-purpose method that achieves satisfactory performance in enhancing the visibility of both underwater and low-light images is proposed. In our study, the formation of these two types of images is described in a unified manner. Subsequently, an objective function is formulated, and several novel regularization terms are imposed on our optimization algorithm to separate incident light and reflectance as well as suppress intensive noise simultaneously. Next, post-processing algorithms are implemented to correct the color distortion of the incident light and improve the contrast of the reflectance. Ultimately, an enhanced image with clear visibility and natural appearance can be achieved by integrating the processed reflectance and incident light. Additionally, comprehensive tests were performed to compare the proposed method with other outstanding methods. Experiments on images captured in various scenes demonstrated the effectiveness of the proposed method, as evident in enhanced underwater and low-light images.

[1]  Xiao-Ping Zhang,et al.  A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance Estimation , 2015, IEEE Transactions on Image Processing.

[2]  Huimin Lu,et al.  Underwater Image Super-Resolution by Descattering and Fusion , 2017, IEEE Access.

[3]  Mohua Zhang,et al.  Underwater Image Restoration Based on A New Underwater Image Formation Model , 2018, IEEE Access.

[4]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Luc Van Gool,et al.  DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[6]  Lap-Pui Chau,et al.  Single Underwater Image Restoration Using Adaptive Attenuation-Curve Prior , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[7]  Chen Wei,et al.  Deep Retinex Decomposition for Low-Light Enhancement , 2018, BMVC.

[8]  Joonki Paik,et al.  Dual Autoencoder Network for Retinex-Based Low-Light Image Enhancement , 2018, IEEE Access.

[9]  Xiaoyan Sun,et al.  Structure-Revealing Low-Light Image Enhancement Via Robust Retinex Model , 2018, IEEE Transactions on Image Processing.

[10]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[11]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[12]  Turgay Çelik,et al.  Spatial Entropy-Based Global and Local Image Contrast Enhancement , 2014, IEEE Transactions on Image Processing.

[13]  Chenggang Dai,et al.  Single hazy image restoration using robust atmospheric scattering model , 2020, Signal Process..

[14]  Y.Y. Schechner,et al.  Recovery of underwater visibility and structure by polarization analysis , 2005, IEEE Journal of Oceanic Engineering.

[15]  Huimin Lu,et al.  Contrast enhancement for images in turbid water. , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[17]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[18]  Chong-Yi Li,et al.  Underwater Image Enhancement by Dehazing With Minimum Information Loss and Histogram Distribution Prior. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[19]  Rajiv Soundararajan,et al.  Llrnet: A Multiscale Subband Learning Approach for Low Light Image Restoration , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[20]  Eduardo Cabal-Yepez,et al.  A Fast Image Dehazing Algorithm Using Morphological Reconstruction , 2019, IEEE Transactions on Image Processing.

[21]  Seiichi Serikawa,et al.  Dust removal from high turbid underwater images using convolutional neural networks , 2017, Optics & Laser Technology.

[22]  Antonin Chambolle,et al.  Total Variation Minimization and a Class of Binary MRF Models , 2005, EMMCVPR.

[23]  Xiao-Ping Zhang,et al.  A retinex-based enhancing approach for single underwater image , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[24]  Hai-Miao Hu,et al.  Naturalness Preserved Enhancement Algorithm for Non-Uniform Illumination Images , 2013, IEEE Transactions on Image Processing.

[25]  Qi-Chong Tian,et al.  A variational-based fusion model for non-uniform illumination image enhancement via contrast optimization and color correction , 2018, Signal Process..

[26]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[27]  Adrian Galdran,et al.  Automatic Red-Channel underwater image restoration , 2015, J. Vis. Commun. Image Represent..

[28]  R.W. Schafer,et al.  From frequency to quefrency: a history of the cepstrum , 2004, IEEE Signal Processing Magazine.

[29]  Codruta O. Ancuti,et al.  Color Balance and Fusion for Underwater Image Enhancement , 2018, IEEE Transactions on Image Processing.

[30]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[31]  Nan Wang,et al.  Underwater Image Restoration via Maximum Attenuation Identification , 2017, IEEE Access.

[32]  Delu Zeng,et al.  A fusion-based enhancing method for weakly illuminated images , 2016, Signal Process..

[33]  Seiichi Serikawa,et al.  Low-Light Underwater Image Enhancement for Deep-Sea Tripod , 2019, IEEE Access.

[34]  Jia Xu,et al.  Learning to See in the Dark , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]  K. Bhavani,et al.  LIME: Low-Light Image Enhancement Via Illumination Map Estimation , 2018 .

[36]  Huimin Lu,et al.  Underwater Optical Image Processing: a Comprehensive Review , 2017, Mob. Networks Appl..

[37]  Turgay Çelik,et al.  Contextual and Variational Contrast Enhancement , 2011, IEEE Transactions on Image Processing.

[38]  Chen Gao,et al.  Human-Visual-System-Inspired Underwater Image Quality Measures , 2016, IEEE Journal of Oceanic Engineering.

[39]  Pamela C. Cosman,et al.  Underwater Image Restoration Based on Image Blurriness and Light Absorption , 2017, IEEE Transactions on Image Processing.

[40]  Huimin Lu,et al.  Underwater image dehazing using joint trilateral filter , 2014, Comput. Electr. Eng..

[41]  Yong-Jie Li,et al.  Underwater Image Enhancement Using Adaptive Retinal Mechanisms , 2019, IEEE Transactions on Image Processing.

[42]  Codruta O. Ancuti,et al.  Enhancing underwater images and videos by fusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Nafis Uddin Khan,et al.  Histogram statistics based variance controlled adaptive threshold in anisotropic diffusion for low contrast image enhancement , 2013, Signal Process..

[44]  Silvia Silva da Costa Botelho,et al.  Transmission Estimation in Underwater Single Images , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[45]  Huimin Lu,et al.  Single image dehazing through improved atmospheric light estimation , 2015, Multimedia Tools and Applications.

[46]  Ming Zhang,et al.  Combining Bottom-Up and Top-Down Visual Mechanisms for Color Constancy Under Varying Illumination , 2019, IEEE Transactions on Image Processing.

[47]  Chul Lee,et al.  Contrast Enhancement Based on Layered Difference Representation of 2D Histograms , 2013, IEEE Transactions on Image Processing.

[48]  Junping Du,et al.  Low-Light Image Enhancement via a Deep Hybrid Network , 2019, IEEE Transactions on Image Processing.

[49]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[50]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[51]  Huimin Lu,et al.  Low illumination underwater light field images reconstruction using deep convolutional neural networks , 2018, Future Gener. Comput. Syst..

[52]  Ying-Ching Chen,et al.  Underwater Image Enhancement by Wavelength Compensation and Dehazing , 2012, IEEE Transactions on Image Processing.