Quality Assessment of Perceptual Crosstalk on Two-View Auto-Stereoscopic Displays

Crosstalk is one of the most severe factors affecting the perceived quality of stereoscopic 3D images. It arises from a leakage of light intensity between multiple views, as in auto-stereoscopic displays. Well-known determinants of crosstalk include the co-location contrast and disparity of the left and right images, which have been dealt with in prior studies. However, when a natural stereo image that contains complex naturalistic spatial characteristics is viewed on an auto-stereoscopic display, other factors may also play an important role in the perception of crosstalk. Here, we describe a new way of predicting the perceived severity of crosstalk, which we call the Binocular Perceptual Crosstalk Predictor (BPCP). BPCP uses measurements of three complementary 3D image properties (texture, structural duplication, and binocular summation) in combination with two well-known factors (co-location contrast and disparity) to make predictions of crosstalk on two-view auto-stereoscopic displays. The new BPCP model includes two masking algorithms and a binocular pooling method. We explore a new masking phenomenon that we call duplicated structure masking, which arises from structural correlations between the original and distorted objects. We also utilize an advanced binocular summation model to develop a binocular pooling algorithm. Our experimental results indicate that BPCP achieves high correlations against subjective test results, improving upon those delivered by previous crosstalk prediction models.

[1]  Alan C. Bovik,et al.  Stereoscopic 3D Visual Discomfort Prediction: A Dynamic Accommodation and Vergence Interaction Model , 2016, IEEE Transactions on Image Processing.

[2]  Lili Wang,et al.  Crosstalk Evaluation in Stereoscopic Displays , 2011, Journal of Display Technology.

[3]  Andrew J. Woods,et al.  Understanding Crosstalk in Stereoscopic Displays , 2010 .

[4]  Graham John Woodgate,et al.  Performance of a flat-panel display system convertible between 2D and autostereoscopic 3D modes , 2001, IS&T/SPIE Electronic Imaging.

[5]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Karel Fliegel,et al.  On the accuracy of objective image and video quality models: New methodology for performance evaluation , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[7]  Alan C. Bovik,et al.  Experiments in segmenting texton patterns using localized spatial filters , 1989, Pattern Recognit..

[8]  J. M. Foley,et al.  Contrast masking in human vision. , 1980, Journal of the Optical Society of America.

[9]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Wen-Jean Hsueh,et al.  Measurement of contrast ratios for 3D display , 2000, SPIE Photonics Taiwan.

[11]  Kwanghyun Lee,et al.  3D Perception Based Quality Pooling: Stereopsis, Binocular Rivalry, and Binocular Suppression , 2015, IEEE Journal of Selected Topics in Signal Processing.

[12]  Robert S. Allison,et al.  The Effect of Crosstalk on the Perceived Depth From Disparity and Monocular Occlusions , 2011, IEEE Transactions on Broadcasting.

[13]  P. Surman,et al.  Optical cross-talk and visual comfort of a stereoscopic display used in a real-time application , 2007, Electronic Imaging.

[14]  Jian-Chiun Liou,et al.  Shutter glasses stereo LCD with a dynamic backlight , 2009, Electronic Imaging.

[15]  A. Watson,et al.  A standard model for foveal detection of spatial contrast. , 2005, Journal of vision.

[16]  Lenny Lipton Factors Affecting "Ghosting" In Time-Multiplexed Piano-Stereoscopic Crt Display Systems , 1987, Photonics West - Lasers and Applications in Science and Engineering.

[17]  Sanghoon Lee,et al.  Deep Learning of Human Visual Sensitivity in Image Quality Assessment Framework , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[19]  F. Campbell,et al.  The effect of orientation on the visual resolution of gratings , 1966, The Journal of physiology.

[20]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[21]  Liang Xiao,et al.  Perceptual image quality assessment based on structural similarity and visual masking , 2012, Signal Process. Image Commun..

[22]  Anthony M. Norcia,et al.  Modelfest: year one results and plans for future years , 2000, Electronic Imaging.

[23]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[24]  Touradj Ebrahimi,et al.  Stereoscopic quality datasets under various test conditions , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[25]  Sanghoon Lee,et al.  Fully Deep Blind Image Quality Predictor , 2017, IEEE Journal of Selected Topics in Signal Processing.

[26]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[27]  Alan C. Bovik,et al.  3D Visual Discomfort Prediction: Vergence, Foveation, and the Physiological Optics of Accommodation , 2014, IEEE Journal of Selected Topics in Signal Processing.

[28]  Sheue-Ling Hwang,et al.  System cross-talk and three-dimensional cue issues in autostereoscopic displays , 2013, J. Electronic Imaging.

[29]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[30]  Pierre Boher,et al.  11.2: Distinguished Paper: VCMaster3D: A New Fourier Optics Viewing Angle Instrument for Characterization of Autostereoscopic 3D Displays. , 2009 .

[31]  George Sperling,et al.  A gain-control theory of binocular combination. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Alan C. Bovik,et al.  Automatic Prediction of Perceptual Image and Video Quality , 2013, Proceedings of the IEEE.

[33]  Alan C. Bovik,et al.  Saliency Prediction on Stereoscopic Videos , 2014, IEEE Transactions on Image Processing.

[34]  Erich W Graf,et al.  Natural images dominate in binocular rivalry , 2009, Proceedings of the National Academy of Sciences.

[35]  M. Mcmahon,et al.  The origin of the oblique effect examined with pattern adaptation and masking. , 2003, Journal of vision.

[36]  Neil A. Dodgson Analysis of the viewing zone of multiview autostereoscopic displays , 2002, IS&T/SPIE Electronic Imaging.

[37]  Pierre Boher,et al.  A common approach to characterizing autostereoscopic and polarization-based 3-D displays , 2010 .

[38]  Alan C. Bovik,et al.  Visual quality assessment algorithms: what does the future hold? , 2010, Multimedia Tools and Applications.

[39]  Touradj Ebrahimi,et al.  Assessment of Stereoscopic Crosstalk Perception , 2012, IEEE Transactions on Multimedia.

[40]  Wijnand A. IJsselsteijn,et al.  Perceptual attributes of crosstalk in 3D images , 2005, Displays.