Analysis of Underwater Image Processing Methods for Annotation in Deep Learning Based Fish Detection

With the advent of deep-learning (DL) techniques, image annotation has become a fundamental part of the research process. In the case of underwater image annotation, the human in charge of the task is faced whith the inherent quality problems of this kind of images. A large number of underwater image enhancement (UIE) methods have been developed aimed at improving the colors and contrast of these images. However, no attention has been paid to the specific problem of image annotation. In this case the global image quality of the processed image is less important than the fact that the objects to be annotated stand out and that their contours are easy to delineate. In this paper we evaluate seven state-of-the-art UIE techniques and rank them, through a subjective approach, according to their utility for the annotation process. The conclusion of our study is that, in general, the model-free Multiscale Retinex algorithm is preferred over more complex techniques that try to model the formation of the underwater images.

[1]  Zhenkuan Pan,et al.  UID2021: An Underwater Image Dataset for Evaluation of No-Reference Quality Assessment Metrics , 2022, ACM Trans. Multim. Comput. Commun. Appl..

[2]  Manal Al Ghamdi,et al.  Towards a better understanding of annotation tools for medical imaging: a survey , 2022, Multimedia Tools and Applications.

[3]  Andrea Cavallaro,et al.  Underwater image filtering: methods, datasets and evaluation , 2020, ArXiv.

[4]  Jingchun Zhou,et al.  Classical and state-of-the-art approaches for underwater image defogging: a comprehensive survey , 2020, Frontiers of Information Technology & Electronic Engineering.

[5]  Tie Qiu,et al.  A Review on Intelligence Dehazing and Color Restoration for Underwater Images , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  Kurt Debattista,et al.  Subjective and Objective Evaluation of Local Dimming Algorithms for HDR Images , 2020, IEEE Access.

[7]  Jose Manuel Lopez-Guede,et al.  Video Image Enhancement and Machine Learning Pipeline for Underwater Animal Detection and Classification at Cabled Observatories , 2020, Sensors.

[8]  Guojia Hou,et al.  A novel dark channel prior guided variational framework for underwater image restoration , 2020, J. Vis. Commun. Image Represent..

[9]  Li Qin,et al.  A Survey of Restoration and Enhancement for Underwater Images , 2019, IEEE Access.

[10]  Ke Hu,et al.  An In-Depth Survey of Underwater Image Enhancement and Restoration , 2019, IEEE Access.

[11]  Chongyi Li,et al.  Diving Deeper into Underwater Image Enhancement: A Survey , 2019, Signal Process. Image Commun..

[12]  A JarinaRaihan,et al.  Review of underwater image restoration algorithms , 2019, IET Image Process..

[13]  Wei Song,et al.  An Experimental-Based Review of Image Enhancement and Image Restoration Methods for Underwater Imaging , 2019, IEEE Access.

[14]  Ahmad Salman,et al.  Real-time fish detection in complex backgrounds using probabilistic background modelling , 2019, Ecol. Informatics.

[15]  Huazhu Fu,et al.  Hierarchical Features Driven Residual Learning for Depth Map Super-Resolution , 2019, IEEE Transactions on Image Processing.

[16]  Ming Zhu,et al.  Real-World Underwater Enhancement: Challenges, Benchmarks, and Solutions Under Natural Light , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  S. Kwong,et al.  An Underwater Image Enhancement Benchmark Dataset and Beyond , 2019, IEEE Transactions on Image Processing.

[18]  Bernard Ghanem,et al.  Local Color Mapping Combined with Color Transfer for Underwater Image Enhancement , 2019, 2019 IEEE Winter Conference on Applications of Computer Vision (WACV).

[19]  Fatih Murat Porikli,et al.  Deep Underwater Image Enhancement , 2018, ArXiv.

[20]  Md Jahidul Islam,et al.  Enhancing Underwater Imagery Using Generative Adversarial Networks , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Yan Wang,et al.  An imaging-inspired no-reference underwater color image quality assessment metric , 2017, Comput. Electr. Eng..

[22]  Andrea Cavallaro,et al.  Underwater image and video dehazing with pure haze region segmentation , 2017, Comput. Vis. Image Underst..

[23]  Wangmeng Zuo,et al.  Learning Deep CNN Denoiser Prior for Image Restoration , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Pamela C. Cosman,et al.  Underwater Image Restoration Based on Image Blurriness and Light Absorption , 2017, IEEE Transactions on Image Processing.

[25]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[26]  Huimin Lu,et al.  Underwater Optical Image Processing: a Comprehensive Review , 2017, Mob. Networks Appl..

[27]  Runmin Cong,et al.  Underwater Image Enhancement by Dehazing With Minimum Information Loss and Histogram Distribution Prior , 2016, IEEE Transactions on Image Processing.

[28]  Rafal Mantiuk,et al.  Objective and subjective evaluation of High Dynamic Range video compression , 2016, Signal Process. Image Commun..

[29]  Chen Gao,et al.  Human-Visual-System-Inspired Underwater Image Quality Measures , 2016, IEEE Journal of Oceanic Engineering.

[30]  John E. Eriksson,et al.  Image Quality Ranking Method for Microscopy , 2016, Scientific Reports.

[31]  Changshui Zhang,et al.  DeepFish: Accurate underwater live fish recognition with a deep architecture , 2016, Neurocomputing.

[32]  Arcot Sowmya,et al.  An Underwater Color Image Quality Evaluation Metric , 2015, IEEE Transactions on Image Processing.

[33]  Andrea Cavallaro,et al.  Hierarchical rank-based veiling light estimation for underwater dehazing , 2015, BMVC.

[34]  Raveendran Paramesran,et al.  Visual Quality Evaluation of Image Object Segmentation: Subjective Assessment and Objective Measure , 2015, IEEE Transactions on Image Processing.

[35]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Tao Jin,et al.  Deriving inherent optical properties from background color and underwater image enhancement , 2015 .

[38]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Silvia Silva da Costa Botelho,et al.  Transmission Estimation in Underwater Single Images , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[40]  King Ngi Ngan,et al.  Image Retargeting Quality Assessment: A Study of Subjective Scores and Objective Metrics , 2012, IEEE Journal of Selected Topics in Signal Processing.

[41]  Anne E. James,et al.  Enhancing the low quality images using Unsupervised Colour Correction Method , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[42]  Jan Kautz,et al.  Exposure Fusion , 2009, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[43]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[44]  Jules S. Jaffe,et al.  Computer modeling and the design of optimal underwater imaging systems , 1990 .

[45]  B. L. McGlamery,et al.  A Computer Model For Underwater Camera Systems , 1980, Other Conferences.

[46]  C. Sbert,et al.  On the Importance of Color Pre-Processing for Object Detection in Submarine Images , 2022, CCIA.

[47]  Xin Zhao,et al.  Benchmarking Underwater Image Enhancement and Restoration, and Beyond , 2020, IEEE Access.

[48]  Codruta O. Ancuti,et al.  Color Balance and Fusion for Underwater Image Enhancement , 2018, IEEE Transactions on Image Processing.

[49]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[50]  Mikko Nuutinen,et al.  CVD2014—A Database for Evaluating No-Reference Video Quality Assessment Algorithms , 2016, IEEE Transactions on Image Processing.

[51]  Adrian Galdran,et al.  Automatic Red-Channel underwater image restoration , 2015, J. Vis. Commun. Image Represent..

[52]  Aljoscha Smolic,et al.  Automated Aesthetic Analysis of Photographic Images , 2015, IEEE Transactions on Visualization and Computer Graphics.

[53]  Jean-Michel Morel,et al.  Multiscale Retinex , 2014, Image Process. Line.

[54]  Raimondo Schettini,et al.  Underwater Image Processing: State of the Art of Restoration and Image Enhancement Methods , 2010, EURASIP J. Adv. Signal Process..

[55]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[56]  R. Forthofer,et al.  Rank Correlation Methods , 1981 .

[57]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.