Multiple just-noticeable-difference-based no-reference stereoscopic image quality assessment.

Just-noticeable difference (JND) is an important characteristic of the human visual system (HVS), and some established JND models imitating the perception of human eyes already exist. However, their utilization in stereoscopic image quality assessment (SIQA) remains limited. To better simulate how HVS senses 3D images under a no-reference situation, a novel SIQA method based on multiple JND models is proposed in this paper. In our metric, the stereoscopic image pairs are decomposed into multi-scale monocular views and binocular views. Then, texture and edge information of these multi-scale images is extracted. Next, a monocular JND model, a binocular JND model, and a depth JND model are separately applied to the extracted features and the depth map. Finally, these features are synthesized and mapped to objective scores. Through experiment and comparison on public 3D image databases, the proposed method shows a competitive advantage over most state-of-the-art SIQA methods, which indicates that it has a promising prospect in practical applications.

[1]  Ting Luo,et al.  Utilizing binocular vision to facilitate completely blind 3D image quality measurement , 2016, Signal Process..

[2]  Manoranjan Paul,et al.  Just Noticeable Difference for Images With Decomposition Model for Separating Edge and Textured Regions , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Ting Luo,et al.  Blind quality estimator for 3D images based on binocular combination and extreme learning machine , 2017, Pattern Recognit..

[4]  Warnakulasuriya Anil Chandana Fernando,et al.  Display Dependent Preprocessing of Depth Maps Based on Just Noticeable Depth Difference Modeling , 2011, IEEE Journal of Selected Topics in Signal Processing.

[5]  Zhihan Lv,et al.  Quality assessment for virtual reality technology based on real scene , 2016, Neural Computing and Applications.

[6]  Yang Zhao,et al.  No-reference stereoscopic image quality assessment guided by visual hierarchical structure and binocular effects. , 2018, Applied optics.

[7]  Qionghai Dai,et al.  Full-Reference Quality Assessment of Stereoscopic Images by Learning Binocular Receptive Field Properties , 2015, IEEE Transactions on Image Processing.

[8]  Zhenzhong Chen,et al.  Binocular Just-Noticeable-Difference Model for Stereoscopic Images , 2011, IEEE Signal Processing Letters.

[9]  Wujie Zhou,et al.  Utilizing Dictionary Learning and Machine Learning for Blind Quality Assessment of 3-D Images , 2017, IEEE Transactions on Broadcasting.

[10]  Bin Jiang,et al.  No-reference stereoscopic image quality assessment based on hue summation-difference mapping image and binocular joint mutual filtering. , 2018, Applied optics.

[11]  Chun-Hsien Chou,et al.  A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile , 1995, IEEE Trans. Circuits Syst. Video Technol..

[12]  Steve Ward,et al.  Image Quality Assessment Using the SSIM and the Just Noticeable Difference Paradigm , 2013, HCI.

[13]  Alan C. Bovik,et al.  No-Reference Quality Assessment of Natural Stereopairs , 2013, IEEE Transactions on Image Processing.

[14]  Yong Man Ro,et al.  Critical Binocular Asymmetry Measure for the Perceptual Quality Assessment of Synthesized Stereo 3D Images in View Synthesis , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Wujie Zhou,et al.  Binocular Responses for No-Reference 3D Image Quality Assessment , 2016, IEEE Transactions on Multimedia.

[16]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[17]  Seung-Won Jung,et al.  A Modified Model of the Just Noticeable Depth Difference and Its Application to Depth Sensation Enhancement , 2013, IEEE Transactions on Image Processing.

[18]  Kai Zeng,et al.  Quality Prediction of Asymmetrically Distorted Stereoscopic 3D Images , 2015, IEEE Transactions on Image Processing.

[19]  Subrahmanyam Murala,et al.  Local Tetra Patterns: A New Feature Descriptor for Content-Based Image Retrieval , 2012, IEEE Transactions on Image Processing.

[20]  Weisi Lin,et al.  Perceptual Full-Reference Quality Assessment of Stereoscopic Images by Considering Binocular Visual Characteristics , 2013, IEEE Transactions on Image Processing.

[21]  Kai Li,et al.  Joint binocular energy-contrast perception for quality assessment of stereoscopic images , 2018, Signal Process. Image Commun..

[22]  Lin Ma,et al.  Learning structure of stereoscopic image for no-reference quality assessment with convolutional neural network , 2016, Pattern Recognit..

[23]  Sinan Kalkan,et al.  Deep Hierarchies in the Primate Visual Cortex: What Can We Learn for Computer Vision? , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Sumohana S. Channappayya,et al.  No-reference Stereoscopic Image Quality Assessment Using Natural Scene Statistics , 2016, Signal Process. Image Commun..

[25]  Alan C. Bovik,et al.  Subjective evaluation of stereoscopic image quality , 2013, Signal Process. Image Commun..

[26]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[27]  Alexander Raake,et al.  Evaluating Depth Perception of 3D Stereoscopic Videos , 2012, IEEE Journal of Selected Topics in Signal Processing.

[28]  Qionghai Dai,et al.  Learning Receptive Fields and Quality Lookups for Blind Quality Assessment of Stereoscopic Images , 2016, IEEE Transactions on Cybernetics.

[29]  Mei Yu,et al.  No-reference Stereoscopic Image Quality Assessment Using Binocular Self-similarity and Deep Neural Network , 2016, Signal Process. Image Commun..

[30]  Qionghai Dai,et al.  Learning Sparse Representation for No-Reference Quality Assessment of Multiply Distorted Stereoscopic Images , 2017, IEEE Transactions on Multimedia.

[31]  Yu Zhou,et al.  Quaternion representation based visual saliency for stereoscopic image quality assessment , 2018, Signal Process..

[32]  Patrick Le Callet,et al.  Quality Assessment of Stereoscopic Images , 2008, EURASIP J. Image Video Process..

[33]  Susu Yao,et al.  Just noticeable distortion model and its applications in video coding , 2005, Signal Process. Image Commun..

[34]  Yong Ding,et al.  No-reference Stereoscopic Image Quality Assessment Based on Saliency-guided Binocular Feature Consolidation , 2017 .

[35]  Kamel Mohamed Faraoun,et al.  Stereoscopic image quality metric based on local entropy and binocular just noticeable difference , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[36]  Qionghai Dai,et al.  Toward a Blind Deep Quality Evaluator for Stereoscopic Images Based on Monocular and Binocular Interactions , 2016, IEEE Transactions on Image Processing.

[37]  Kwanghoon Sohn,et al.  No-Reference Quality Assessment for Stereoscopic Images Based on Binocular Quality Perception , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  Do-Kyoung Kwon,et al.  Full-reference quality assessment of stereopairs accounting for rivalry , 2013, Signal Process. Image Commun..

[39]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.