A Highly Efficient Blind Image Quality Assessment Metric of 3-D Synthesized Images Using Outlier Detection

With multitudes of image processing applications, image quality assessment (IQA) has become a prerequisite for obtaining maximally distinctive statistics from images. Despite the widespread research in this domain over several years, existing IQA algorithms have a number of key limitations concerning different image distortion types and algorithms’ computational efficiency. Images that are synthesized using depth image-based rendering have applications in various disciplines, such as free viewpoint videos, which enable synthesis of novel realistic images in the referenceless environment. In the literature, very few no-reference (NR) quality assessment metrics of three-dimensional (3-D) synthesized images are proposed, and most of them are computationally expensive, which makes it difficult for them to be deployed in real-time applications. In this paper, we attribute the geometrically distorted pixels as outliers in 3-D synthesized images. This assumption is validated using the three $sigma$ rule-based robust outlyingness ratio. We propose a novel fast and accurate blind IQA metric of 3-D synthesized images using nonlinear median filtering since the median filtering has the capability of identifying and removing outliers. The advantages of the proposed algorithm are twofold. First, it uses a simple technique, i.e., median filtering, to capture the level of geometric and structural distortions (up to some extend). Second, the proposed algorithm has higher computational efficiency. Experiments show the superiority of the proposed NR IQA algorithm over existing state-of-the-art full-, reduced-, and NR IQA methods, in terms of both predicting accuracy and computational complexity.

[1]  Weisi Lin,et al.  Just Noticeable Difference for natural images using RMS contrast and feed-back mechanism , 2018, Neurocomputing.

[2]  Weisi Lin,et al.  Fourier Transform-Based Scalable Image Quality Measure , 2012, IEEE Transactions on Image Processing.

[3]  Chunping Hou,et al.  Biologically Inspired Blind Quality Assessment of Tone-Mapped Images , 2018, IEEE Transactions on Industrial Electronics.

[4]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[5]  Alan C. Bovik,et al.  RRED Indices: Reduced Reference Entropic Differencing for Image Quality Assessment , 2012, IEEE Transactions on Image Processing.

[6]  Jaejoon Lee,et al.  Depth Map Coding Based on Synthesized View Distortion Function , 2011, IEEE Journal of Selected Topics in Signal Processing.

[7]  Patrick Le Callet,et al.  DIBR synthesized image quality assessment based on morphological wavelets , 2015, 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX).

[8]  C.-C. Jay Kuo,et al.  MCL-3D: A Database for Stereoscopic Image Quality Assessment using 2D-Image-Plus-Depth Source , 2014, J. Inf. Sci. Eng..

[9]  Patrick Le Callet,et al.  Objective image quality assessment of 3D synthesized views , 2015, Signal Process. Image Commun..

[10]  Chang-Su Kim,et al.  FDQM: Fast Quality Metric for Depth Maps Without View Synthesis , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Zhou Wang,et al.  Unified Blind Quality Assessment of Compressed Natural, Graphic, and Screen Content Images , 2017, IEEE Transactions on Image Processing.

[12]  Chunping Hou,et al.  Combining Local and Global Measures for DIBR-Synthesized Image Quality Evaluation , 2019, IEEE Transactions on Image Processing.

[13]  Rabul Hussain Laskar,et al.  Region Adaptive Fuzzy Filter: An Approach for Removal of Random-Valued Impulse Noise , 2018, IEEE Transactions on Industrial Electronics.

[14]  Xiongkuo Min,et al.  Blind Quality Assessment Based on Pseudo-Reference Image , 2018, IEEE Transactions on Multimedia.

[15]  Chunping Hou,et al.  Blind Quality Assessment of Tone-Mapped Images Considering Colorfulness, Naturalness, and Structure , 2019, IEEE Transactions on Industrial Electronics.

[16]  Gangyi Jiang,et al.  High-Efficiency 3D Depth Coding Based on Perceptual Quality of Synthesized Video , 2016, IEEE Transactions on Image Processing.

[17]  Dragan D. Kukolj,et al.  Multi–Scale Synthesized View Assessment Based on Morphological Pyramids , 2016 .

[18]  Wenjun Zhang,et al.  Hybrid No-Reference Quality Metric for Singly and Multiply Distorted Images , 2014, IEEE Transactions on Broadcasting.

[19]  Patrick Le Callet,et al.  DIBR synthesized image quality assessment based on morphological pyramids , 2015, 2015 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[20]  Zhou-Ping Yin,et al.  A Universal Denoising Framework With a New Impulse Detector and Nonlocal Means , 2012, IEEE Transactions on Image Processing.

[21]  N. Atzpadin,et al.  Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability , 2007, Signal Process. Image Commun..

[22]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[23]  Daniel Thalmann,et al.  Model-Based Referenceless Quality Metric of 3D Synthesized Images Using Local Image Description , 2018, IEEE Transactions on Image Processing.

[24]  C.-C. Jay Kuo,et al.  Subjective and Objective Video Quality Assessment of 3D Synthesized Views With Texture/Depth Compression Distortion , 2015, IEEE Transactions on Image Processing.

[25]  Wenjun Zhang,et al.  No-Reference Quality Metric of Contrast-Distorted Images Based on Information Maximization , 2017, IEEE Transactions on Cybernetics.

[26]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[27]  Sunil Prasad Jaiswal,et al.  A Prediction Backed Model for Quality Assessment of Screen Content and 3-D Synthesized Images , 2018, IEEE Transactions on Industrial Informatics.

[28]  Patrick Le Callet,et al.  Towards a New Quality Metric for 3-D Synthesized View Assessment , 2011, IEEE Journal of Selected Topics in Signal Processing.

[29]  Pierre-Henri Conze,et al.  Objective view synthesis quality assessment , 2012, Electronic Imaging.

[30]  Kai Zeng,et al.  Quality assessment of multi-view-plus-depth images , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).