3D Visual Attention for Stereoscopic Image Quality Assessment

Depth perception is one of the most important characteristic in three-dimensional (3D) images different from traditional two-dimensional (2D) images. Therefore, 3D visual attention will be advantageous to improve 3D visual experience and particularly depth perception. In this paper, we propose a 3D visual attention model for stereoscopic image quality assessment task. The proposed model is constructed based on 2D saliency model, center bias, depth cue (foreground cue and background). Different combination and modulation means of the 3D visual attention model for quality assessment are investigated. The experimental results show that compared with other schemes, the proposed 3D visual attention-based pooling scheme can achieve higher consistency with the subjective assessment of stereoscopic images.

[1]  Patrick Le Callet,et al.  Overt visual attention for free-viewing and quality assessment tasks Impact of the regions of interest on a video quality metric , 2010 .

[2]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Yun Zhang,et al.  Considering binocular spatial sensitivity in stereoscopic image quality assessment , 2011, 2011 Visual Communications and Image Processing (VCIP).

[4]  Peter Kauff,et al.  Three-Dimensional Video Postproduction and Processing , 2011, Proceedings of the IEEE.

[5]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[6]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  Ken Chen,et al.  Asymmetric Coding of Multi-View Video Plus Depth Based 3-D Video for View Rendering , 2012, IEEE Transactions on Multimedia.

[8]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[9]  He Jiang,et al.  A Video Denoising Method with 3D Surfacelet Transform Based on Block matching and Grouping , 2012, J. Comput..

[10]  Miska M. Hannuksela,et al.  Perceptual quality assessment based on visual attention analysis , 2009, ACM Multimedia.

[11]  Harish Katti,et al.  Depth Matters: Influence of Depth Cues on Visual Saliency , 2012, ECCV.

[12]  Nick Holliman,et al.  Stereoscopic image quality metrics and compression , 2008, Electronic Imaging.

[13]  Liang-Gee Chen,et al.  Brain-Inspired Framework for Fusion of Multiple Depth Cues , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Hong Ren Wu,et al.  Stereo Image Quality Assessment Using Visual Attention and Distortion Predictors , 2011, KSII Trans. Internet Inf. Syst..

[15]  Marcus Barkowsky,et al.  The Importance of Visual Attention in Improving the 3D-TV Viewing Experience: Overview and New Perspectives , 2011, IEEE Transactions on Broadcasting.

[16]  Patrick Le Callet,et al.  A coherent computational approach to model bottom-up visual attention , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Olivier Le Meur,et al.  A Time-Dependent Saliency Model Combining Center and Depth Biases for 2D and 3D Viewing Conditions , 2012, Cognitive Computation.

[18]  Namho Hur,et al.  Stereoscopic 3D visual attention model considering comfortable viewing , 2012 .

[19]  Mohamed-Chaker Larabi,et al.  A perceptual metric for stereoscopic image quality assessment based on the binocular energy , 2013, Multidimens. Syst. Signal Process..

[20]  Alan C. Bovik,et al.  Subjective evaluation of stereoscopic image quality , 2013, Signal Process. Image Commun..

[21]  Yuan Yan Tang,et al.  Visual saliency detection with center shift , 2013, Neurocomputing.

[22]  Markus Vincze,et al.  Learning What Matters: Combining Probabilistic Models of 2D and 3D Saliency Cues , 2011, ICVS.

[23]  Aldo Maalouf,et al.  CYCLOP: A stereo color image quality assessment metric , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Do-Kyoung Kwon,et al.  Full-reference quality assessment of stereopairs accounting for rivalry , 2013, Signal Process. Image Commun..

[25]  Mei Yu,et al.  Subjective quality analyses of stereoscopic images in 3DTV system , 2011, 2011 Visual Communications and Image Processing (VCIP).

[26]  Marcus Barkowsky,et al.  Video quality assessment: From 2D to 3D — Challenges and future trends , 2010, 2010 IEEE International Conference on Image Processing.

[27]  Touradj Ebrahimi,et al.  A comprehensive database and subjective evaluation methodology for quality of experience in stereoscopic video , 2010, Electronic Imaging.

[28]  Hui Wang,et al.  A Method of Target Region Detection Based on Multi-channel Weighted Visual Attention , 2013, J. Comput..

[29]  Hui Xu,et al.  Novel Fused Image Quality Measures Based on Structural Similarity , 2012, J. Comput..

[30]  Ulrich Engelke,et al.  Visual Attention in Quality Assessment , 2011, IEEE Signal Processing Magazine.

[31]  Ken Chen,et al.  Depth perceptual region-of-interest based multiview video coding , 2010, J. Vis. Commun. Image Represent..

[32]  Wijnand A. IJsselsteijn,et al.  Evaluation of Stereoscopic Images: Beyond 2D Quality , 2011, IEEE Transactions on Broadcasting.

[33]  Junle Wang,et al.  Study of depth bias of observers in free viewing of still stereoscopic synthetic stimuli , 2012 .

[34]  Ingrid Heynderickx,et al.  Visual Attention in Objective Image Quality Assessment: Based on Eye-Tracking Data , 2011, IEEE Transactions on Circuits and Systems for Video Technology.