Color Correction Based on CFA and Enhancement Based on Retinex With Dense Pixels for Underwater Images

Color correction and enhancement for underwater images is challenging due to attenuation and scattering. The underwater images often have low visibility and suffer from color bias. This paper presents a novel color correction method based on color filter array (CFA) and an enhancement method based on Retinex with dense pixels and adaptive linear histogram transformation for degraded color-biased underwater images. For any digital image in the RGB space, which is captured by digital camera with CFA, their RGB values are dependent and coupled because of the interpolation process. So we try to compensate red channel attenuation of underwater degraded images from the green channel and blue channel. Retinex model has been widely used to efficiently handle low brightness and blurred images. The McCann Retinex (MR) method selects a spiral path for pixel comparison to estimate illumination. However, the simple path selection doesn’t include global light dark relationship of the whole image. So we design a scheme to gain much well-distributed and denser pixels to obtain more precise intensity of illumination. Besides, we design a piecewise linear function for histogram transform, which is adaptive to the whole RGB value. Experiments on a large number of underwater degraded images show that, the processed images by our method have clearer details and uniform visual effect for all channels in RGB color space and our method can also obtain good performance metrics.

[1]  Zia-ur Rahman,et al.  Multi-scale retinex for color image enhancement , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[2]  Benjamin McLellan Sustainability Assessment of Deep Ocean Resources , 2014 .

[3]  A JarinaRaihan,et al.  Review of underwater image restoration algorithms , 2019, IET Image Process..

[4]  Andrea Cavallaro,et al.  Underwater image and video dehazing with pure haze region segmentation , 2017, Comput. Vis. Image Underst..

[5]  Alvarez-GilaAitor,et al.  Automatic Red-Channel underwater image restoration , 2015 .

[6]  Pamela C. Cosman,et al.  Generalization of the Dark Channel Prior for Single Image Restoration , 2018, IEEE Transactions on Image Processing.

[7]  G D Finlayson,et al.  Color constancy at a pixel. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[8]  Runmin Cong,et al.  A hybrid method for underwater image correction , 2017, Pattern Recognit. Lett..

[9]  Wei Song,et al.  Shallow-Water Image Enhancement Using Relative Global Histogram Stretching Based on Adaptive Parameter Acquisition , 2018, MMM.

[10]  Chao Chen,et al.  Enhancing underwater image by dark channel prior and color correction , 2016, 2016 Sixth International Conference on Information Science and Technology (ICIST).

[11]  Huimin Lu,et al.  Underwater Optical Image Processing: a Comprehensive Review , 2017, Mob. Networks Appl..

[12]  Anne E. James,et al.  Enhancing the low quality images using Unsupervised Colour Correction Method , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[13]  Marc Ebner,et al.  Color Constancy , 2007, Computer Vision, A Reference Guide.

[14]  Dacheng Tao,et al.  An Underwater Image Enhancement Benchmark Dataset and Beyond , 2019, IEEE Transactions on Image Processing.

[15]  Huimin Lu,et al.  Underwater image dehazing using joint trilateral filter , 2014, Comput. Electr. Eng..

[16]  Jie Li,et al.  WaterGAN: Unsupervised Generative Network to Enable Real-Time Color Correction of Monocular Underwater Images , 2017, IEEE Robotics and Automation Letters.

[17]  Jian Wang,et al.  Single underwater image enhancement based on color cast removal and visibility restoration , 2016, J. Electronic Imaging.

[18]  Yong-Jie Li,et al.  Underwater Image Enhancement Using Adaptive Retinal Mechanisms , 2019, IEEE Transactions on Image Processing.

[19]  Y. Jay Guo,et al.  Gamma-Correction-Based Visibility Restoration for Single Hazy Images , 2018, IEEE Signal Processing Letters.

[20]  Xiangyong Cao,et al.  Underwater image enhancement with global-local networks and compressed-histogram equalization , 2020, Signal Process. Image Commun..

[21]  Wei Song,et al.  A Rapid Scene Depth Estimation Model Based on Underwater Light Attenuation Prior for Underwater Image Restoration , 2018, PCM.

[22]  Chunle Guo,et al.  Emerging From Water: Underwater Image Color Correction Based on Weakly Supervised Color Transfer , 2017, IEEE Signal Processing Letters.

[23]  Chong-Yi Li,et al.  Underwater Image Enhancement by Dehazing With Minimum Information Loss and Histogram Distribution Prior. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[24]  Lap-Pui Chau,et al.  Single Underwater Image Restoration Using Adaptive Attenuation-Curve Prior , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[25]  Nor Ashidi Mat Isa,et al.  Underwater image quality enhancement through integrated color model with Rayleigh distribution , 2015, Appl. Soft Comput..

[26]  Pamela C. Cosman,et al.  Underwater Image Restoration Based on Image Blurriness and Light Absorption , 2017, IEEE Transactions on Image Processing.

[27]  Nor Ashidi Mat Isa,et al.  Enhancement of low quality underwater image through integrated global and local contrast correction , 2015, Appl. Soft Comput..

[28]  E. Land The retinex theory of color vision. , 1977, Scientific American.

[29]  Zi Huang,et al.  Deep-Sea Organisms Tracking Using Dehazing and Deep Learning , 2018, Mob. Networks Appl..

[30]  R. A. Salam,et al.  Underwater Image Enhancement Using an Integrated Colour Model , 2007 .

[31]  D H Brainard,et al.  Analysis of the retinex theory of color vision. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[32]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[33]  Aongus McCarthy,et al.  Object Depth Profile and Reflectivity Restoration From Sparse Single-Photon Data Acquired in Underwater Environments , 2016, IEEE Transactions on Computational Imaging.

[34]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[35]  Xiao-Ping Zhang,et al.  A retinex-based enhancing approach for single underwater image , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[36]  Wei Song,et al.  An Experimental-Based Review of Image Enhancement and Image Restoration Methods for Underwater Imaging , 2019, IEEE Access.

[37]  D. Foster Color constancy , 2011, Vision Research.

[38]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[39]  Donna M. Kocak,et al.  A Focus on Recent Developments and Trends in Underwater Imaging , 2008 .

[40]  Nan Wang,et al.  Underwater Image Restoration via Maximum Attenuation Identification , 2017, IEEE Access.

[41]  Tony Jacob,et al.  Joint Color Space GMMs for CFA Demosaicking , 2019, IEEE Signal Processing Letters.

[42]  Manisha Ingle,et al.  Underwater Image Restoration Based on Light Absorption , 2018, 2018 Fourth International Conference on Computing Communication Control and Automation (ICCUBEA).

[43]  Huimin Lu,et al.  Contrast enhancement for images in turbid water. , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[44]  C CosmanPamela,et al.  Underwater Image Restoration Based on Image Blurriness and Light Absorption , 2017 .

[45]  Lei Zhang,et al.  A Feature-Enriched Completely Blind Image Quality Evaluator , 2015, IEEE Transactions on Image Processing.

[46]  Silvia Silva Da Costa Botelho,et al.  Underwater Single Image Restoration Using Dark Channel Prior , 2014, 2014 Symposium on Automation and Computation for Naval, Offshore and Subsea (NAVCOMP).

[47]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[48]  Chen Gao,et al.  Human-Visual-System-Inspired Underwater Image Quality Measures , 2016, IEEE Journal of Oceanic Engineering.

[49]  Tao Jin,et al.  Deriving inherent optical properties from background color and underwater image enhancement , 2015 .

[50]  Chia-Chi Sung,et al.  Underwater image restoration by red-dark channel prior and point spread function deconvolution , 2015, 2015 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[51]  G. Dhivyasri,et al.  Underwater image enhancement by dark channel prior , 2015, 2015 2nd International Conference on Electronics and Communication Systems (ICECS).

[52]  Xinghao Ding,et al.  Two-step approach for single underwater image enhancement , 2017, 2017 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[53]  Codruta O. Ancuti,et al.  Enhancing underwater images and videos by fusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[54]  Tie Qiu,et al.  A Review on Intelligence Dehazing and Color Restoration for Underwater Images , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[55]  Chia-Chi Sung,et al.  Single Underwater Image Restoration Based on Depth Estimation and Transmission Compensation , 2019, IEEE Journal of Oceanic Engineering.

[56]  Huimin Lu,et al.  Low illumination underwater light field images reconstruction using deep convolutional neural networks , 2018, Future Gener. Comput. Syst..

[57]  Codruta O. Ancuti,et al.  Color Balance and Fusion for Underwater Image Enhancement , 2018, IEEE Transactions on Image Processing.

[58]  Mario Fernando Montenegro Campos,et al.  Underwater Depth Estimation and Image Restoration Based on Single Images , 2016, IEEE Computer Graphics and Applications.