Underwater Image Quality Assessment: Subjective and Objective Methods

Underwater image enhancement plays a critical role in marine industry. Various algorithms are applied to enhance underwater images, but their performance in terms of perceptual quality has been little studied. In this paper, we investigate five popular enhancement algorithms and their output image quality. To this end, we have created a benchmark, including images enhanced by different algorithms and ground truth image quality obtained by human perception experiments. We statistically analyse the impact of various enhancement algorithms on the perceived quality of underwater images. Also, the visual quality provided by these algorithms is evaluated objectively, aiming to inform the development of objective metrics for automatic assessment of the quality for underwater image enhancement. The image quality benchmark and its objective metric are made publicly available.

[1]  Wei Li,et al.  Decorrelation-stretch based cloud detection for total sky images , 2015, 2015 Visual Communications and Image Processing (VCIP).

[2]  Mohinder Malhotra.  Single Image Haze Removal Using Dark Channel Prior , 2016 .

[3]  Dacheng Tao,et al.  An Underwater Image Enhancement Benchmark Dataset and Beyond , 2019, IEEE Transactions on Image Processing.

[4]  Daoliang Li,et al.  Multi-scale enhancement fusion for underwater sea cucumber images based on human visual system modelling , 2020, Comput. Electron. Agric..

[5]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[6]  Wen Gao,et al.  Blind Quality Assessment of Camera Images Based on Low-Level and High-Level Statistical Features , 2019, IEEE Transactions on Multimedia.

[7]  Arcot Sowmya,et al.  An Underwater Color Image Quality Evaluation Metric , 2015, IEEE Transactions on Image Processing.

[8]  Xi Qiao,et al.  Underwater image quality enhancement of sea cucumbers based on improved histogram equalization and wavelet transform , 2017 .

[9]  Shree K. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[10]  Pei-Yin Chen,et al.  Low Complexity Underwater Image Enhancement Based on Dark Channel Prior , 2011, 2011 Second International Conference on Innovations in Bio-inspired Computing and Applications.

[11]  Xiongkuo Min,et al.  Blind Quality Assessment Based on Pseudo-Reference Image , 2018, IEEE Transactions on Multimedia.

[12]  Lucjan Janowski,et al.  The Accuracy of Subjects in a Quality Experiment: A Theoretical Subject Model , 2015, IEEE Transactions on Multimedia.

[13]  Shree K. Nayar,et al.  Chromatic framework for vision in bad weather , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[14]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[15]  Ke Gu,et al.  Reduced Reference Stereoscopic Image Quality Assessment Using Sparse Representation and Natural Scene Statistics , 2020, IEEE Transactions on Multimedia.

[16]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[17]  David Doubilet.  Light in the Sea , 2022, World Literature Today.

[18]  Weisi Lin,et al.  Which Has Better Visual Quality: The Clear Blue Sky or a Blurry Animal? , 2019, IEEE Transactions on Multimedia.

[19]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[20]  Jie Li,et al.  WaterGAN: Unsupervised Generative Network to Enable Real-Time Color Correction of Monocular Underwater Images , 2017, IEEE Robotics and Automation Letters.

[21]  Weisi Lin,et al.  No-Reference and Robust Image Sharpness Evaluation Based on Multiscale Spatial and Spectral Features , 2017, IEEE Transactions on Multimedia.

[22]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[23]  Tao Xiang,et al.  Blind Night-Time Image Quality Assessment: Subjective and Objective Approaches , 2020, IEEE Transactions on Multimedia.

[24]  Ahmad Shahrizan Abdul Ghani,et al.  Image contrast enhancement using an integration of recursive-overlapped contrast limited adaptive histogram specification and dual-image wavelet fusion for the high visibility of deep underwater image , 2018 .

[25]  Dah-Jye Lee,et al.  An automated fish species classification and migration monitoring system , 2003, IECON'03. 29th Annual Conference of the IEEE Industrial Electronics Society (IEEE Cat. No.03CH37468).

[26]  Yoann Baveye,et al.  AccAnn: A New Subjective Assessment Methodology for Measuring Acceptability and Annoyance of Quality of Experience , 2019, IEEE Transactions on Multimedia.

[27]  Jichang Guo,et al.  Underwater image enhancement by dehazing and color correction , 2015, J. Electronic Imaging.

[28]  Sos S. Agaian,et al.  Parameterized Logarithmic Framework for Image Enhancement , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[30]  Pamela C. Cosman,et al.  Generalization of the Dark Channel Prior for Single Image Restoration , 2018, IEEE Transactions on Image Processing.

[31]  Patrick Le Callet,et al.  Semi-Reference Sonar Image Quality Assessment Based on Task and Visual Perception , 2020 .

[32]  Vittorio Murino,et al.  Underwater Computer Vision and Pattern Recognition , 2000, Comput. Vis. Image Underst..

[33]  Wen Gao,et al.  Blind Quality Assessment of Tone-Mapped Images Via Analysis of Information, Naturalness, and Structure , 2016, IEEE Transactions on Multimedia.

[34]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[35]  Ana Maria Mendonça,et al.  Retinal Image Quality Assessment by Mean-Subtracted Contrast-Normalized Coefficients , 2017 .

[36]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  William K. Pratt,et al.  Digital Image Processing: PIKS Inside , 2001 .

[38]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[39]  Runmin Cong,et al.  Underwater Image Enhancement by Dehazing With Minimum Information Loss and Histogram Distribution Prior , 2016, IEEE Transactions on Image Processing.

[40]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[41]  Pamela C. Cosman,et al.  Underwater Image Restoration Based on Image Blurriness and Light Absorption , 2017, IEEE Transactions on Image Processing.

[42]  Robert A. Hummel,et al.  Image Enhancement by Histogram transformation , 1975 .

[43]  Yang Wang,et al.  A deep CNN method for underwater image enhancement , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[44]  Weisi Lin,et al.  Personality-Assisted Multi-Task Learning for Generic and Personalized Image Aesthetics Assessment , 2020, IEEE Transactions on Image Processing.

[45]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[46]  Hadi Hadizadeh,et al.  Full-Reference Objective Quality Assessment of Tone-Mapped Images , 2017, IEEE Transactions on Multimedia.

[47]  Qiang Xu,et al.  Evaluation of body weight of sea cucumber Apostichopus japonicus by computer vision , 2014, Chinese Journal of Oceanology and Limnology.

[48]  Rui Xu,et al.  Underwater Image Enhancement Using Stacked Generative Adversarial Networks , 2018, PCM.

[49]  Weisi Lin,et al.  No-Reference Image Blur Assessment Based on Discrete Orthogonal Moments , 2016, IEEE Transactions on Cybernetics.

[50]  Codruta O. Ancuti,et al.  Enhancing underwater images and videos by fusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  J. Bednar,et al.  Alpha-trimmed means and their relationship to median filters , 1984 .

[52]  Chen Gao,et al.  Human-Visual-System-Inspired Underwater Image Quality Measures , 2016, IEEE Journal of Oceanic Engineering.

[53]  Fan Zhang,et al.  Reduced-Reference Image Quality Assessment Using Reorganized DCT-Based Image Representation , 2011, IEEE Transactions on Multimedia.

[54]  Y.Y. Schechner,et al.  Recovery of underwater visibility and structure by polarization analysis , 2005, IEEE Journal of Oceanic Engineering.

[55]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[56]  Hua Huang,et al.  No-reference image quality assessment based on spatial and spectral entropies , 2014, Signal Process. Image Commun..

[57]  Md Jahidul Islam,et al.  Enhancing Underwater Imagery Using Generative Adversarial Networks , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).