Perceptual Crosstalk Prediction on Autostereoscopic 3D Display

Perceptual crosstalk prediction for autostereoscopic 3D displays is of fundamental importance in determining the level of quality perceived by humans in terms of the display performance and the 3D viewing experience. However, no robust framework exists to quantify perceptual crosstalk while taking into account the hardware structure of a display as well as its content characteristics via content analysis. In this paper, we present a 3D perceptual crosstalk predictor (3D-PCP) that can be used to predict crosstalk in a unique way when viewing autostereoscopic 3D displays. 3D-PCP captures hardware features using an optical Fourier transform-light measurement device and content features through content analysis based on information theory. By deriving the disparity, luminance, color, and texture maps, this approach defines the visual entropy, mutual information, and relative entropy in order to investigate the influences of the 3D scene characteristics on perceptual crosstalk. The experimental results demonstrate that the 3D-PCP output is highly correlated with subjective scores.

[1]  Judith Redi,et al.  Supporting visual quality assessment with machine learning , 2013, EURASIP Journal on Image and Video Processing.

[2]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[3]  M. De A review of the concept of "Panum's fusional areas". , 1966 .

[4]  Walter F. Bischof,et al.  Detection of Linear Structures in Remote-Sensed Images , 2009, ICIAR.

[5]  Ann Dooms,et al.  A Locally Adaptive System for the Fusion of Objective Quality Measures , 2014, IEEE Transactions on Image Processing.

[6]  Andrew J. Woods How are crosstalk and ghosting defined in the stereoscopic literature? , 2011, Electronic Imaging.

[7]  Alberto Leon-Garcia,et al.  Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[8]  Alan C. Bovik,et al.  3D Visual Activity Assessment Based on Natural Scene Statistics , 2014, IEEE Transactions on Image Processing.

[9]  Alan C. Bovik,et al.  3D Visual Discomfort Predictor: Analysis of Disparity and Neural Activity Statistics , 2015, IEEE Transactions on Image Processing.

[10]  A. Gotchev,et al.  Software for simulation of artefacts and database of impaired videos , 2009 .

[11]  Christine Connolly,et al.  A study of efficiency and accuracy in the transformation from RGB to CIELAB color space , 1997, IEEE Trans. Image Process..

[12]  Pierre Boher,et al.  11.2: Distinguished Paper: VCMaster3D: A New Fourier Optics Viewing Angle Instrument for Characterization of Autostereoscopic 3D Displays. , 2009 .

[13]  Hakan Urey,et al.  State of the Art in Stereoscopic and Autostereoscopic Displays , 2011, Proceedings of the IEEE.

[14]  Pierre Boher,et al.  Multispectral polarization viewing angle analysis of circular polarized stereoscopic 3D displays , 2010, Electronic Imaging.

[15]  Lili Wang,et al.  Crosstalk Evaluation in Stereoscopic Displays , 2011, Journal of Display Technology.

[16]  Lenny Lipton Factors Affecting "Ghosting" In Time-Multiplexed Piano-Stereoscopic Crt Display Systems , 1987, Photonics West - Lasers and Applications in Science and Engineering.

[17]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[18]  Alan C. Bovik,et al.  Optimal Channel Adaptation of Scalable Video Over a Multicarrier-Based Multicell Environment , 2009, IEEE Transactions on Multimedia.

[19]  Alan C. Bovik,et al.  Multimodal Interactive Continuous Scoring of Subjective 3D Video Quality of Experience , 2014, IEEE Transactions on Multimedia.

[20]  Dong-Hoon Kang,et al.  Perceptual Strength of 3-D Crosstalk in Both Achromatic and Color Images in Stereoscopic 3-D Displays , 2012, IEEE Transactions on Image Processing.

[21]  Robert S. Allison,et al.  The Effect of Crosstalk on the Perceived Depth From Disparity and Monocular Occlusions , 2011, IEEE Transactions on Broadcasting.

[22]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[23]  Touradj Ebrahimi,et al.  Assessment of Stereoscopic Crosstalk Perception , 2012, IEEE Transactions on Multimedia.

[24]  D E Mitchell,et al.  A review of the concept of "Panum's fusional areas". , 1966, American journal of optometry and archives of American Academy of Optometry.

[25]  Gregory C DeAngelis,et al.  Coding of horizontal disparity and velocity by MT neurons in the alert macaque. , 2003, Journal of neurophysiology.

[26]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[27]  Jian-Chiun Liou,et al.  Shutter glasses stereo LCD with a dynamic backlight , 2009, Electronic Imaging.

[28]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[30]  Alan C. Bovik,et al.  3D Visual Discomfort Prediction: Vergence, Foveation, and the Physiological Optics of Accommodation , 2014, IEEE Journal of Selected Topics in Signal Processing.

[31]  Francis Quek,et al.  Comparison of five color models in skin pixel classification , 1999, Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No.PR00378).

[32]  P. Surman,et al.  Optical cross-talk and visual comfort of a stereoscopic display used in a real-time application , 2007, Electronic Imaging.

[33]  S. Nadarajah A generalized normal distribution , 2005 .

[34]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[35]  Joydeep Ghosh,et al.  Algorithmic assessment of 3D quality of experience for images and videos , 2011, 2011 Digital Signal Processing and Signal Processing Education Meeting (DSP/SPE).