A reference-free underwater image quality assessment metric in frequency domain

Abstract Owing to the complexity of the underwater environment and the limitations of imaging devices, the quality of underwater images varies differently, which may affect the practical applications in modern military, scientific research, and other fields. Thus, achieving subjective quality assessment to distinguish different qualities of underwater images has an important guiding role for subsequent tasks. In this paper, considering the underwater image degradation effect and human visual perception scheme, an effective reference-free underwater image quality assessment metric is designed by combining the colorfulness, contrast, and sharpness cues. Specifically, inspired by the different sensibility of humans to high-frequency and low-frequency information, we design a more comprehensive color measurement in spatial domain and frequency domain. In addition, for the low contrast caused by the backward scattering, we propose a dark channel prior weighted contrast measure to enhance the discrimination ability of the original contrast measurement. The sharpness measurement is used to evaluate the blur effect caused by the forward scattering of the underwater image. Finally, these three measurements are combined by the weighted summation, where the weighed coefficients are obtained by multiple linear regression. Moreover, we collect a large dataset for underwater image quality assessment for testing and evaluating different methods. Experiments on this dataset demonstrate the superior performance both qualitatively and quantitatively.

[1]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[2]  Qingming Huang,et al.  Going From RGB to RGBD Saliency: A Depth-Guided Transformation Model , 2020, IEEE Transactions on Cybernetics.

[3]  Fatih Murat Porikli,et al.  Underwater scene prior inspired deep underwater image and video enhancement , 2020, Pattern Recognit..

[4]  Huihui Bai,et al.  Deep Interleaved Network for Image Super-Resolution With Asymmetric Co-Attention , 2020, ArXiv.

[5]  Guangming Shi,et al.  Visual structural degradation based reduced-reference image quality assessment , 2016, Signal Process. Image Commun..

[6]  Lijuan Tang,et al.  A reduced-reference quality assessment metric for super-resolution reconstructed images with information gain and texture similarity , 2019, Signal Process. Image Commun..

[7]  Paolo Napoletano,et al.  On the use of deep learning for blind image quality assessment , 2016, Signal Image Video Process..

[8]  P. Alam ‘S’ , 2021, Composites Engineering: An A–Z Guide.

[9]  Codruta O. Ancuti,et al.  Enhancing underwater images and videos by fusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Ying-Ching Chen,et al.  Underwater Image Enhancement by Wavelength Compensation and Dehazing , 2012, IEEE Transactions on Image Processing.

[11]  Chong-Yi Li,et al.  Underwater Image Enhancement by Dehazing With Minimum Information Loss and Histogram Distribution Prior. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[12]  Jason Jianjun Gu,et al.  No-reference blur assessment based on edge modeling , 2015, J. Vis. Commun. Image Represent..

[13]  Sabine Süsstrunk,et al.  Image aesthetic predictors based on weighted CNNs , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[14]  Huazhu Fu,et al.  Hierarchical Features Driven Residual Learning for Depth Map Super-Resolution , 2019, IEEE Transactions on Image Processing.

[15]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[17]  Hua Huang,et al.  No-reference image quality assessment in curvelet domain , 2014, Signal Process. Image Commun..

[18]  Sebastian Bosse,et al.  A deep neural network for image quality assessment , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[19]  Arcot Sowmya,et al.  An Underwater Color Image Quality Evaluation Metric , 2015, IEEE Transactions on Image Processing.

[20]  Chen Gao,et al.  Human-Visual-System-Inspired Underwater Image Quality Measures , 2016, IEEE Journal of Oceanic Engineering.

[21]  Yiannis Demiris,et al.  Context-Aware Deep Feature Compression for High-Speed Visual Tracking , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[22]  Kai-Kuang Ma,et al.  A Gabor Feature-Based Quality Assessment Model for the Screen Content Images , 2018, IEEE Transactions on Image Processing.

[23]  Qingming Huang,et al.  DPANet: Depth Potentiality-Aware Gated Attention Network for RGB-D Salient Object Detection. , 2020, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[24]  Sam Kwong,et al.  Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Wenjun Zhang,et al.  No-Reference Quality Metric of Contrast-Distorted Images Based on Information Maximization , 2017, IEEE Transactions on Cybernetics.

[26]  Huimin Lu,et al.  Underwater image de-scattering and classification by deep neural network , 2016, Comput. Electr. Eng..

[27]  Runmin Cong,et al.  A hybrid method for underwater image correction , 2017, Pattern Recognit. Lett..

[28]  Sebastian Bosse,et al.  Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment , 2016, IEEE Transactions on Image Processing.

[29]  Dacheng Tao,et al.  An Underwater Image Enhancement Benchmark Dataset and Beyond , 2019, IEEE Transactions on Image Processing.

[30]  Li Wen,et al.  Towards Real-Time Advancement of Underwater Visual Quality With GAN , 2017, IEEE Transactions on Industrial Electronics.

[31]  Sam Kwong,et al.  Nested Network With Two-Stream Pyramid for Salient Object Detection in Optical Remote Sensing Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Weisi Lin,et al.  Reduced-reference quality assessment of image super-resolution by energy change and texture variation , 2019, J. Vis. Commun. Image Represent..

[33]  Kai-Kuang Ma,et al.  Gradient Direction for Screen Content Image Quality Assessment , 2016, IEEE Signal Processing Letters.

[34]  Jian Wang,et al.  Single underwater image enhancement based on color cast removal and visibility restoration , 2016, J. Electronic Imaging.

[35]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[36]  Sos S. Agaian,et al.  Choosing the Optimal Spatial Domain Measure of Enhancement for Mammogram Images , 2014, Int. J. Biomed. Imaging.

[37]  Guangming Shi,et al.  No-reference image quality assessment with visual pattern degradation , 2019, Inf. Sci..

[38]  Qingming Huang,et al.  Image Saliency Detection Video Saliency Detection Co-saliency Detection Temporal RGBD Saliency Detection Motion , 2018 .

[39]  Joost van de Weijer,et al.  RankIQA: Learning from Rankings for No-Reference Image Quality Assessment , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[40]  Yo-Sung Ho,et al.  Blind Image Quality Measurement by Exploiting High-Order Statistics With Deep Dictionary Encoding Network , 2020, IEEE Transactions on Instrumentation and Measurement.

[41]  Huazhu Fu,et al.  PDR-Net: Perception-Inspired Single Image Dehazing Network With Refinement , 2020, IEEE Transactions on Multimedia.

[42]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[43]  Eric Brassart,et al.  Colour Image Segmentation Using Homogeneity Method and Data Fusion Techniques , 2010, EURASIP J. Adv. Signal Process..

[44]  Yi Li,et al.  Convolutional Neural Networks for No-Reference Image Quality Assessment , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  SchettiniRaimondo,et al.  Underwater image processing , 2010 .

[46]  Radomír Mech,et al.  Deep Multi-patch Aggregation Network for Image Style, Aesthetics, and Quality Estimation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[47]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[48]  Yan Wang,et al.  An imaging-inspired no-reference underwater color image quality assessment metric , 2017, Comput. Electr. Eng..

[49]  Wenjun Zhang,et al.  Deep learning network for blind image quality assessment , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[50]  Lei Zhang,et al.  Learning without Human Scores for Blind Image Quality Assessment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Xiaochun Cao,et al.  Dense Attention Fluid Network for Salient Object Detection in Optical Remote Sensing Images , 2020, IEEE Transactions on Image Processing.

[52]  Qingming Huang,et al.  Global Context-Aware Progressive Aggregation Network for Salient Object Detection , 2020, AAAI.

[53]  Qingming Huang,et al.  Depth Potentiality-Aware Gated Attention Network for RGB-D Salient Object Detection , 2020, ArXiv.

[54]  Saeed Mahmoudpour,et al.  Reduced-reference quality assessment of multiply-distorted images based on structural and uncertainty information degradation , 2018, J. Vis. Commun. Image Represent..

[55]  Qingming Huang,et al.  ASIF-Net: Attention Steered Interweave Fusion Network for RGB-D Salient Object Detection , 2020, IEEE Transactions on Cybernetics.

[56]  Kai-Kuang Ma,et al.  ESIM: Edge Similarity for Screen Content Image Quality Assessment , 2017, IEEE Transactions on Image Processing.