Multi-scale enhancement fusion for underwater sea cucumber images based on human visual system modelling

Abstract The vision computing techniques are widely used in the marine industry. In order to improve the detection and recognition accuracy of artificial intelligence-robotics, we propose a novel underwater image enhancement algorithm, using a multi-scale fusion approach based on the properties of the human visual system. Our method fuses the results of underwater image enhancement algorithms that deal with the color-casting, sharpness and contrast degradation. The method is further weighted by a human visual system-based image structure map that combines Michaelson-like contrast map, saliency map, dark channel map and exposed map. The multi-scale fusion strategy is used to avoid the artifacts of sharpness blending based on Laplacian image representation. The results show that our algorithm can recover more detail information of dark regions and improve the overall visual quality of underwater images.

[1]  S. Duntley.  Light in the Sea , 1963 .

[2]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[3]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Jian Wang,et al.  Single underwater image restoration by blue-green channels dehazing and red channel correction , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Codruta O. Ancuti,et al.  Color Balance and Fusion for Underwater Image Enhancement , 2018, IEEE Transactions on Image Processing.

[6]  Bong-Huan Jun,et al.  Development of arm and leg for seabed walking robot CRABSTER200 , 2016 .

[7]  Farooq Anwar,et al.  High-Value Components and Bioactives from Sea Cucumbers for Functional Foods—A Review , 2011, Marine drugs.

[8]  Pei-Yin Chen,et al.  Low Complexity Underwater Image Enhancement Based on Dark Channel Prior , 2011, 2011 Second International Conference on Innovations in Bio-inspired Computing and Applications.

[9]  Pamela C. Cosman,et al.  Generalization of the Dark Channel Prior for Single Image Restoration , 2018, IEEE Transactions on Image Processing.

[10]  Ana Maria Mendonça,et al.  Retinal Image Quality Assessment by Mean-Subtracted Contrast-Normalized Coefficients , 2017 .

[11]  Vittorio Murino,et al.  Underwater Computer Vision and Pattern Recognition , 2000, Comput. Vis. Image Underst..

[12]  Anne E. James,et al.  Enhancing the low quality images using Unsupervised Colour Correction Method , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[13]  Lap-Pui Chau,et al.  Single Underwater Image Restoration Using Adaptive Attenuation-Curve Prior , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[14]  Hany Farid,et al.  Blind inverse gamma correction , 2001, IEEE Trans. Image Process..

[15]  Chen Gao,et al.  Human-Visual-System-Inspired Underwater Image Quality Measures , 2016, IEEE Journal of Oceanic Engineering.

[16]  Marko Tscherepanow,et al.  A saliency map based on sampling an image into random rectangular regions of interest , 2012, Pattern Recognit..

[17]  Dominique Pelletier,et al.  Underwater video techniques for observing coastal marine biodiversity: A review of sixty years of publications (1952–2012) , 2014 .

[18]  Qiang Xu,et al.  Evaluation of body weight of sea cucumber Apostichopus japonicus by computer vision , 2014, Chinese Journal of Oceanology and Limnology.

[19]  Massimo Caccia,et al.  A survey on real-time motion estimation techniques for underwater robots , 2014, Journal of Real-Time Image Processing.

[20]  Robert Bogue,et al.  Underwater robots: a review of technologies and applications , 2015, Ind. Robot.

[21]  Xi Qiao,et al.  Underwater image quality enhancement of sea cucumbers based on improved histogram equalization and wavelet transform , 2017 .

[22]  Codruta O. Ancuti,et al.  Enhancing underwater images and videos by fusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Paul Ozog,et al.  Long‐term Mapping Techniques for Ship Hull Inspection and Surveillance using an Autonomous Underwater Vehicle , 2016, J. Field Robotics.

[24]  Christoph Ament,et al.  First testing of an AUV mission planning and guidance system for water quality monitoring and fish behavior observation in net cage fish farming , 2014 .

[25]  Dacheng Tao,et al.  An Underwater Image Enhancement Benchmark Dataset and Beyond , 2019, IEEE Transactions on Image Processing.

[26]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[27]  Wei Song,et al.  A Rapid Scene Depth Estimation Model Based on Underwater Light Attenuation Prior for Underwater Image Restoration , 2018, PCM.

[28]  R. A. Salam,et al.  Underwater Image Enhancement Using an Integrated Colour Model , 2007 .

[29]  M. S. Hitam,et al.  Mixture contrast limited adaptive histogram equalization for underwater image enhancement , 2013, 2013 International Conference on Computer Applications Technology (ICCAT).

[30]  Nor Ashidi Mat Isa,et al.  Enhancement of low quality underwater image through integrated global and local contrast correction , 2015, Appl. Soft Comput..

[31]  Junzhi Yu,et al.  Development of an Underwater Manipulator and Its Free-Floating Autonomous Operation , 2016, IEEE/ASME Transactions on Mechatronics.

[32]  Y.Y. Schechner,et al.  Recovery of underwater visibility and structure by polarization analysis , 2005, IEEE Journal of Oceanic Engineering.

[33]  E. Trucco,et al.  Self-Tuning Underwater Image Restoration , 2006, IEEE Journal of Oceanic Engineering.

[34]  Karen Panetta,et al.  Contrast enhancement for underwater images in maritime border protection , 2017, 2017 IEEE International Symposium on Technologies for Homeland Security (HST).

[35]  Nor Ashidi Mat Isa,et al.  Underwater image quality enhancement through integrated color model with Rayleigh distribution , 2015, Appl. Soft Comput..

[36]  Pamela C. Cosman,et al.  Underwater Image Restoration Based on Image Blurriness and Light Absorption , 2017, IEEE Transactions on Image Processing.

[37]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.