3D Perception Based Quality Pooling: Stereopsis, Binocular Rivalry, and Binocular Suppression

One of the most challenging ongoing issues in the field of 3D visual research is how to interpret human 3D perception over virtual 3D space between the human eye and a 3D display. When a human being perceives a 3D structure, the brain classifies the scene into the binocular or monocular vision region depending on the availability of binocular depth perception in the unit of a certain region (coarse 3D perception). The details of the scene are then perceived by applying visual sensitivity to the classified 3D structure (fine 3D perception) with reference to the fixation. Furthermore, we include the coarse and fine 3D perception in the quality assessment, and propose a human 3D Perception-based Stereo image quality pooling (3DPS) model. In 3DPS we divide the stereo image into segment units, and classify each segment as either the binocular or monocular vision region. We assess the stereo image according to the classification by applying different visual weights to the pooling method to achieve more accurate quality assessment. In particular, it is demonstrated that 3DPS performs remarkably for quality assessment of stereo images distorted by coding and transmission errors.

[1]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[2]  Jerry D. Nguyenkim,et al.  Disparity-Based Coding of Three-Dimensional Surface Orientation by Macaque Middle Temporal Neurons , 2003, The Journal of Neuroscience.

[3]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[4]  R. Blake © 2001 Kluwer Academic Publishers. Printed in the Netherlands. 5 A Primer on Binocular Rivalry, Including Current Controversies , 2000 .

[5]  D. Regan,et al.  Visual perception of changing size: The effect of object size , 1979, Vision Research.

[6]  Ian P. Howard,et al.  Seeing in Depth , 2008 .

[7]  Yun Zhang,et al.  Considering binocular spatial sensitivity in stereoscopic image quality assessment , 2011, 2011 Visual Communications and Image Processing (VCIP).

[8]  Do-Kyoung Kwon,et al.  Full-reference quality assessment of stereopairs accounting for rivalry , 2013, Signal Process. Image Commun..

[9]  Patrick Le Callet,et al.  Quality Assessment of Stereoscopic Images , 2008, EURASIP J. Image Video Process..

[10]  Marios S. Pattichis,et al.  Foveated video quality assessment , 2002, IEEE Trans. Multim..

[11]  Peter Neri,et al.  A stereoscopic look at visual cortex. , 2005, Journal of neurophysiology.

[12]  G. Orban,et al.  Three-Dimensional Shape Coding in Inferior Temporal Cortex , 2000, Neuron.

[13]  Ahmet M. Kondoz,et al.  Quality Evaluation of Color Plus Depth Map-Based Stereoscopic Video , 2009, IEEE Journal of Selected Topics in Signal Processing.

[14]  Shinji Takase,et al.  Local binocular fusion is involved in global binocular rivalry , 2008, Vision Research.

[15]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[16]  Alan C. Bovik,et al.  Visual Importance Pooling for Image Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[17]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[18]  L K Cormack,et al.  Element density and the efficiency of binocular matching. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[19]  R. Blake,et al.  Neural bases of binocular rivalry , 2006, Trends in Cognitive Sciences.

[20]  Alan C. Bovik,et al.  Study on distortion conspicuity in stereoscopically viewed 3D images , 2011, 2011 IEEE 10th IVMSP Workshop: Perception and Visual Signal Analysis.

[21]  Alan C. Bovik,et al.  Subjective evaluation of stereoscopic image quality , 2013, Signal Process. Image Commun..

[22]  Ahmet M. Kondoz,et al.  Quality analysis for 3D video using 2D video quality models , 2008, IEEE Transactions on Consumer Electronics.

[23]  A. Parker,et al.  Stereoscopic Vision in the Absence of the Lateral Occipital Cortex , 2010, PloS one.

[24]  P. Grobstein Analysis of Visual Behavior, David J. Ingle, Melvyn A. Goodale, Richard J.W. Mansfield (Eds.). MIT press, Cambridge, MA and London (1982), 834 , 1983 .

[25]  Peter Gregor,et al.  Binocular single vision achieved by fusion and suppression , 1977 .

[26]  M. Landy,et al.  Why Is Spatial Stereoresolution So Low? , 2004, The Journal of Neuroscience.

[27]  Weisi Lin,et al.  Perceptual Full-Reference Quality Assessment of Stereoscopic Images by Considering Binocular Visual Characteristics , 2013, IEEE Transactions on Image Processing.

[28]  Wijnand A. IJsselsteijn,et al.  Evaluation of Stereoscopic Images: Beyond 2D Quality , 2011, IEEE Transactions on Broadcasting.

[29]  N. Logothetis Single units and conscious vision. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[30]  Nick Holliman,et al.  Stereoscopic image quality metrics and compression , 2008, Electronic Imaging.

[31]  Silvio P. Sabatini,et al.  Eye Position Encoding in Three-Dimensional Space: Integration of Version and Vergence Signals in the Medial Posterior Parietal Cortex , 2012, The Journal of Neuroscience.

[32]  Hideyuki Tamura,et al.  Gaze-directed adaptive rendering for interacting with virtual space , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[33]  A. Aksay,et al.  Towards compound stereo-video quality metric: a specific encoder-based framework , 2006, 2006 IEEE Southwest Symposium on Image Analysis and Interpretation.

[34]  Alan C. Bovik,et al.  Video Quality Pooling Adaptive to Perceptual Distortion Severity , 2013, IEEE Transactions on Image Processing.

[35]  Alexander Bobkov,et al.  Visual 3D Perception of Motion Environment and Visibility Factors in Virtual Space , 2012, Trans. Comput. Sci..

[36]  Junyong You,et al.  PERCEPTUAL QUALITY ASSESSMENT FOR STEREOSCOPIC IMAGES BASED ON 2 D IMAGE QUALITY METRICS AND DISPARITY ANALYSIS , 2010 .

[37]  Alan C. Bovik,et al.  Fast algorithms for foveated video processing , 2003, IEEE Trans. Circuits Syst. Video Technol..

[38]  R. Blake,et al.  What is Suppressed during Binocular Rivalry? , 1980, Perception.

[39]  M. Meenes A Phenomenological Description of Retinal Rivalry , 1930 .

[40]  Alan C. Bovik,et al.  No-Reference Quality Assessment of Natural Stereopairs , 2013, IEEE Transactions on Image Processing.

[41]  R. Blake,et al.  Spatial zones of binocular rivalry in central and peripheral vision , 1992, Visual Neuroscience.

[42]  Alan C. Bovik,et al.  Saliency Prediction on Stereoscopic Videos , 2014, IEEE Transactions on Image Processing.

[43]  Aldo Maalouf,et al.  CYCLOP: A stereo color image quality assessment metric , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[44]  Munchurl Kim,et al.  A perceptual quality assessment metric using temporal complexity and disparity information for stereoscopic video , 2011, 2011 18th IEEE International Conference on Image Processing.

[45]  Alan C. Bovik,et al.  3D Visual Activity Assessment Based on Natural Scene Statistics , 2014, IEEE Transactions on Image Processing.

[46]  Wilson S. Geisler,et al.  Real-time foveated multiresolution system for low-bandwidth video communication , 1998, Electronic Imaging.

[47]  Ed Lantz,et al.  Future directions in visual display systems , 1997, COMG.

[48]  C. Clifford Binocular rivalry , 2009, Current Biology.

[49]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[50]  Yuan Zhou,et al.  Objective quality assessment method of stereo images , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[51]  Marios S. Pattichis,et al.  Foveated video compression with optimal rate control , 2001, IEEE Trans. Image Process..

[52]  Pietro Perona,et al.  On the usefulness of attention for object recognition , 2004 .