Quality Index for Stereoscopic Images by Separately Evaluating Adding and Subtracting

The human visual system (HVS) plays an important role in stereo image quality perception. Therefore, it has aroused many people’s interest in how to take advantage of the knowledge of the visual perception in image quality assessment models. This paper proposes a full-reference metric for quality assessment of stereoscopic images based on the binocular difference channel and binocular summation channel. For a stereo pair, the binocular summation map and binocular difference map are computed first by adding and subtracting the left image and right image. Then the binocular summation is decoupled into two parts, namely additive impairments and detail losses. The quality of binocular summation is obtained as the adaptive combination of the quality of detail losses and additive impairments. The quality of binocular summation is computed by using the Contrast Sensitivity Function (CSF) and weighted multi-scale (MS-SSIM). Finally, the quality of binocular summation and binocular difference is integrated into an overall quality index. The experimental results indicate that compared with existing metrics, the proposed metric is highly consistent with the subjective quality assessment and is a robust measure. The result have also indirectly proved hypothesis of the existence of binocular summation and binocular difference channels.

[1]  A. Watanabe,et al.  Spatial sine-wave responses of the human visual system. , 1968, Vision research.

[2]  T E Cohn,et al.  Binocular vision: two possible central interactions between signals from two eyes. , 1976, Science.

[3]  Matthias Wöpking,et al.  Viewing comfort with stereoscopic pictures : an experimental study on the subjective effects of disparity magnitude and depth of focus , 1995 .

[4]  F. A. Miles Binocular Vision and Stereopsis by Ian P. Howard and Brian J. Rogers, Oxford University Press, 1995. £90.00 (736 pages) ISBN 0 19 508476 4. , 1996, Trends in Neurosciences.

[5]  R. L. Pandey Vimal,et al.  Orientation tuning of the spatial-frequency-tuned mechanisms of the red-green channel. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  John D. Villasenor,et al.  Visibility of wavelet quantization noise , 1997, IEEE Transactions on Image Processing.

[7]  Wijnand A. IJsselsteijn,et al.  Subjective evaluation of stereoscopic images: effects of camera parameters and display duration , 2000, IEEE Trans. Circuits Syst. Video Technol..

[8]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[9]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[11]  A. Aksay,et al.  Towards compound stereo-video quality metric: a specific encoder-based framework , 2006, 2006 IEEE Southwest Symposium on Image Analysis and Interpretation.

[12]  Patrick Le Callet,et al.  Using disparity for quality assessment of stereoscopic images , 2008, 2008 15th IEEE International Conference on Image Processing.

[13]  Yuan Zhou,et al.  Objective quality assessment method of stereo images , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[14]  Hujun Bao,et al.  Consistent Depth Maps Recovery from a Video Sequence , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Roushain Akhter,et al.  No-reference stereoscopic image quality assessment , 2010, Electronic Imaging.

[16]  Fan Zhang,et al.  Limitation and challenges of image quality measurement , 2010, Visual Communications and Image Processing.

[17]  Junyong You,et al.  PERCEPTUAL QUALITY ASSESSMENT FOR STEREOSCOPIC IMAGES BASED ON 2 D IMAGE QUALITY METRICS AND DISPARITY ANALYSIS , 2010 .

[18]  Mei Yu,et al.  Subjective quality analyses of stereoscopic images in 3DTV system , 2011, 2011 Visual Communications and Image Processing (VCIP).

[19]  Aldo Maalouf,et al.  CYCLOP: A stereo color image quality assessment metric , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Takashi Shibata,et al.  Visual discomfort with stereo displays: effects of viewing distance and direction of vergence-accommodation conflict , 2011, Electronic Imaging.

[21]  Munchurl Kim,et al.  A perceptual quality assessment metric using temporal complexity and disparity information for stereoscopic video , 2011, 2011 18th IEEE International Conference on Image Processing.

[22]  Yun Zhang,et al.  Considering binocular spatial sensitivity in stereoscopic image quality assessment , 2011, 2011 Visual Communications and Image Processing (VCIP).

[23]  Patrick Le Callet,et al.  Towards a New Quality Metric for 3-D Synthesized View Assessment , 2011, IEEE Journal of Selected Topics in Signal Processing.

[24]  Fan Zhang,et al.  Image Quality Assessment by Separately Evaluating Detail Losses and Additive Impairments , 2011, IEEE Transactions on Multimedia.

[25]  F. Kingdom Binocular Vision: The Eyes Add and Subtract , 2012, Current Biology.

[26]  Robert S Allison,et al.  Stereoscopy and the Human Visual System. , 2011, SMPTE motion imaging journal.

[27]  Qiang Gao,et al.  Objective quality assessment of stereo images with Human Visual characteristic , 2012, 2012 5th International Congress on Image and Signal Processing.

[28]  Feng Qi,et al.  Quality of experience assessment for stereoscopic images , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[29]  K. May,et al.  Perceived Direction of Motion Determined by Adaptation to Static Binocular Images , 2012, Current Biology.

[30]  Touradj Ebrahimi,et al.  Paired comparison-based subjective quality assessment of stereoscopic images , 2013, Multimedia Tools and Applications.

[31]  Do-Kyoung Kwon,et al.  Full-reference quality assessment of stereopairs accounting for rivalry , 2013, Signal Process. Image Commun..

[32]  Weisi Lin,et al.  Perceptual Full-Reference Quality Assessment of Stereoscopic Images by Considering Binocular Visual Characteristics , 2013, IEEE Transactions on Image Processing.

[33]  Helder Araújo,et al.  Stereoscopic Depth Perception Using a Model Based on the Primary Visual Cortex , 2013, PloS one.

[34]  Mohamed-Chaker Larabi,et al.  A perceptual metric for stereoscopic image quality assessment based on the binocular energy , 2013, Multidimens. Syst. Signal Process..

[35]  Jianjun Lei,et al.  The objective quality assessment of stereo image , 2013, Neurocomputing.

[36]  Dacheng Tao,et al.  Large-Margin Multi-ViewInformation Bottleneck , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Ying Wang,et al.  Integration of 3D Structure from Disparity into Biological Motion Perception Independent of Depth Awareness , 2014, PloS one.

[38]  Ja-Ling Wu,et al.  Quality Assessment of Stereoscopic 3D Image Compression by Binocular Integration Behaviors , 2014, IEEE Transactions on Image Processing.

[39]  Richard P. Wildes,et al.  Spacetime Stereo and 3D Flow via Binocular Spatiotemporal Orientation Analysis , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Myungjin Cho,et al.  Improved Viewing Zones for Projection Type Integral Imaging 3D Display Using Adaptive Liquid Crystal Prism Array , 2014, Journal of Display Technology.

[41]  Jiachen Yang,et al.  Objective Evaluation Criteria for Stereo Camera Shooting Quality Under Different Shooting Parameters and Shooting Distances , 2015, IEEE Sensors Journal.

[42]  Fei Zhou,et al.  Image Quality Assessment Based on Inter-Patch and Intra-Patch Similarity , 2015, PloS one.

[43]  The True Vision - Capture, Transmission and Display of 3D Video, 3DTV-Conference 2016, Hamburg, Germany, July 4-6, 2016 , 2016, 3DTV-Conference.