Perceptual quality measurement of 3D images based on binocular vision.

Three-dimensional (3D) technology has become immensely popular in recent years and widely adopted in various applications. Hence, perceptual quality measurement of symmetrically and asymmetrically distorted 3D images has become an important, fundamental, and challenging issue in 3D imaging research. In this paper, we propose a binocular-vision-based 3D image-quality measurement (IQM) metric. Consideration of the 3D perceptual properties of the primary visual cortex (V1) and the higher visual areas (V2) for 3D-IQM is the major technical contribution to this research. To be more specific, first, the metric simulates the receptive fields of complex cells (V1) using binocular energy response and binocular rivalry response and the higher visual areas (V2) using local binary patterns features. Then, three similarity scores of 3D perceptual properties between the reference and distorted 3D images are measured. Finally, by using support vector regression, three similarity scores are integrated into an overall 3D quality score. Experimental results for two public benchmark databases demonstrate that, in comparison with most current 2D and 3D metrics, the proposed metric achieves significantly higher consistency in alignment with subjective fidelity ratings.

[1]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Zaiqing Chen,et al.  An experimental study on the relationship between maximum disparity and comfort disparity in stereoscopic video , 2012, Photonics Asia.

[3]  Haisong Xu,et al.  Comprehensive model for predicting perceptual image quality of smart mobile devices. , 2015, Applied optics.

[4]  Ian van der Linde Multiresolution image compression using image foveation and simulated depth of field for stereoscopic displays , 2004 .

[5]  D. C. Essen,et al.  Neurons in monkey visual area V2 encode combinations of orientations , 2007, Nature Neuroscience.

[6]  J. Anthony Movshon,et al.  Neuronal Responses to Texture-Defined Form in Macaque Visual Area V2 , 2011, The Journal of Neuroscience.

[7]  Qian Li,et al.  Saliency structure stereoscopic image quality assessment method , 2014 .

[8]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[9]  Hua-Tsung Chen,et al.  Vanishing Point-Based Image Transforms for Enhancement of Probabilistic Occupancy Map-Based People Localization , 2014, IEEE Transactions on Image Processing.

[10]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Chaminda T. E. R. Hewage,et al.  Reduced-reference quality assessment for 3D video compression and transmission , 2011, IEEE Transactions on Consumer Electronics.

[12]  S. Grossberg,et al.  Binocular fusion and invariant category learning due to predictive remapping during scanning of a depthful scene with eye movements , 2015, Front. Psychol..

[13]  Mei Yu,et al.  Binocular energy response based quality assessment of stereoscopic images , 2014, Digit. Signal Process..

[14]  Hongyu Li,et al.  VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment , 2014, IEEE Transactions on Image Processing.

[15]  J Sun,et al.  Optically rewritable 3D liquid crystal displays. , 2014, Optics letters.

[16]  David J. Fleet,et al.  Neural encoding of binocular disparity: Energy models, position shifts and phase shifts , 1996, Vision Research.

[17]  Wijnand A. IJsselsteijn,et al.  Evaluation of Stereoscopic Images: Beyond 2D Quality , 2011, IEEE Transactions on Broadcasting.

[18]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[19]  T. Klingberg,et al.  Increased prefrontal and parietal activity after training of working memory , 2004, Nature Neuroscience.

[20]  Wa Wijnand IJsselsteijn,et al.  Visual discomfort in stereoscopic displays: a review , 2007, Electronic Imaging.

[21]  Mohamed-Chaker Larabi,et al.  A perceptual metric for stereoscopic image quality assessment based on the binocular energy , 2013, Multidimens. Syst. Signal Process..

[22]  P. Downing,et al.  Interactions Between Visual Working Memory and Selective Attention , 2000, Psychological science.

[23]  Ian van der Linde,et al.  Influence of affective image content on subjective quality assessment. , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[24]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[25]  Minh Vo,et al.  Accurate 3D shape measurement of multiple separate objects with stereo vision , 2014 .

[26]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[27]  Shahina Pardhan,et al.  How does aging affect the types of error made in a visual short-term memory ‘object-recall’ task? , 2015, Front. Aging Neurosci..

[28]  R. Blake,et al.  The precedence of binocular fusion over binocular rivalry , 1985, Perception & psychophysics.

[29]  Ahmet M. Kondoz,et al.  Quality analysis for 3D video using 2D video quality models , 2008, IEEE Transactions on Consumer Electronics.

[30]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..

[31]  Martin Laurenzis,et al.  Image coding for three-dimensional range-gated imaging. , 2011, Applied optics.

[32]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[33]  Michael S. Lewicki,et al.  Emergence of complex cell properties by learning to generalize in natural scenes , 2009, Nature.

[34]  Nick Holliman,et al.  Stereoscopic image quality metrics and compression , 2008, Electronic Imaging.

[35]  Mei Yu,et al.  PMFS: A Perceptual Modulated Feature Similarity Metric for Stereoscopic Image Quality Assessment , 2014, IEEE Signal Processing Letters.

[36]  Ian van der Linde,et al.  Spatiotemporal priming facilitates visual-short term memory only in a forward-direction , 2013 .

[37]  Patrick Le Callet,et al.  Quality Assessment of Stereoscopic Images , 2008, EURASIP J. Image Video Process..

[38]  Jian Lu,et al.  Residual stresses measurement by using ring-core method and 3D digital image correlation technique , 2013 .

[39]  Torkel Klingberg,et al.  Polymorphisms in the Dopamine Receptor 2 Gene Region Influence Improvements during Working Memory Training in Children and Adolescents , 2014, Journal of Cognitive Neuroscience.

[40]  Raju P Sapkota,et al.  Manual tapping enhances visual short-term memory performance where visual and motor coordinates correspond. , 2013, British journal of psychology.

[41]  Sinan Kalkan,et al.  Deep Hierarchies in the Primate Visual Cortex: What Can We Learn for Computer Vision? , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Geunyoung Yoon,et al.  Binocular visual performance and summation after correcting higher order aberrations , 2012, Biomedical optics express.