3D Visual Discomfort Prediction: Vergence, Foveation, and the Physiological Optics of Accommodation

To achieve clear binocular vision, neural processes that accomplish accommodation and vergence are performed via two collaborative, cross-coupled processes: accommodation-vergence (AV) and vergence-accommodation (VA). However, when people watch stereo images on stereoscopic displays, normal neural functioning may be disturbed owing to anomalies of the cross-link gains. These anomalies are likely the main cause of visual discomfort experienced when viewing stereo images, and are called Accommodation-Vergence Mismatches (AVM). Moreover, the absence of any useful accommodation depth cues when viewing 3D content on a flat panel (planar) display induces anomalous demands on binocular fusion, resulting in possible additional visual discomfort. Most prior efforts in this direction have focused on predicting anomalies in the AV cross-link using measurements on a computed disparity map. We further these contributions by developing a model that accounts for both accommodation and vergence, resulting in a new visual discomfort prediction algorithm dubbed the 3D-AVM Predictor. The 3D-AVM model and algorithm make use of a new concept we call local 3D bandwidth (BW) which is defined in terms of the physiological optics of binocular vision and foveation. The 3D-AVM Predictor accounts for anomalous motor responses of both accommodation and vergence, yielding predictive power that is statistically superior to prior models that rely on a computed disparity distribution only.

[1]  P. Kaufman,et al.  Accommodation and presbyopia. , 2001, International ophthalmology clinics.

[2]  Alan C. Bovik,et al.  Video Quality Pooling Adaptive to Perceptual Distortion Severity , 2013, IEEE Transactions on Image Processing.

[3]  Kwanghoon Sohn,et al.  Visual Fatigue Prediction for Stereoscopic Image , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Junle Wang,et al.  Quantifying how the combination of blur and disparity affects the perceived depth , 2011, Electronic Imaging.

[5]  Yong Man Ro,et al.  Visual Importance- and Discomfort Region-Selective Low-Pass Filtering for Reducing Visual Discomfort in Stereoscopic Displays , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Henry H. Emurian,et al.  Some Factors Affecting Reports of Visual Fatigue Resulting from Use of a VDU. , 1996 .

[7]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[10]  Wilson S. Geisler,et al.  Real-time foveated multiresolution system for low-bandwidth video communication , 1998, Electronic Imaging.

[11]  Arnold J. Wilkins,et al.  Discomfort and the cortical haemodynamic response to coloured gratings , 2013, Vision Research.

[12]  Alan C. Bovik,et al.  Visual Importance Pooling for Image Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[13]  J. C. Kotulak,et al.  Dynamic interactions between accommodation and convergence are velocity sensitive , 1986, Vision Research.

[14]  Martin S Banks,et al.  Focus information is used to interpret binocular images. , 2010, Journal of vision.

[15]  Makoto Okui,et al.  Parallax distribution for ease of viewing in stereoscopic HDTV , 2002, IS&T/SPIE Electronic Imaging.

[16]  Yong Man Ro,et al.  Predicting Visual Discomfort Using Object Size and Disparity Information in Stereoscopic Images , 2013, IEEE Transactions on Broadcasting.

[17]  Austin Roorda,et al.  A population study on changes in wave aberrations with accommodation. , 2004, Journal of vision.

[18]  Alan C. Bovik,et al.  Multimodal Interactive Continuous Scoring of Subjective 3D Video Quality of Experience , 2014, IEEE Transactions on Multimedia.

[19]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[20]  Marios S. Pattichis,et al.  Foveated video compression with optimal rate control , 2001, IEEE Trans. Image Process..

[21]  S J Anderson,et al.  Peripheral spatial vision: limits imposed by optics, photoreceptors, and receptor pooling. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[22]  Alan C. Bovik,et al.  Study on distortion conspicuity in stereoscopically viewed 3D images , 2011, 2011 IEEE 10th IVMSP Workshop: Perception and Visual Signal Analysis.

[23]  Susana Marcos,et al.  The depth-of-field of the human eye from objective and subjective measurements , 1999, Vision Research.

[24]  Fumio Okano,et al.  Measurement of parallax distribution and its application to the analysis of visual comfort for stereoscopic HDTV , 2003, IS&T/SPIE Electronic Imaging.

[25]  F. Okano,et al.  Repeated vergence adaptation causes the decline of visual functions in watching stereoscopic television , 2005, Journal of Display Technology.

[26]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[27]  Alan C. Bovik,et al.  No-Reference Quality Assessment of Natural Stereopairs , 2013, IEEE Transactions on Image Processing.

[28]  M. Ernst,et al.  Focus cues affect perceived depth. , 2005, Journal of vision.

[29]  Alan C. Bovik,et al.  Saliency Prediction on Stereoscopic Videos , 2014, IEEE Transactions on Image Processing.

[30]  J. Krakauer,et al.  Error correction, sensory prediction, and adaptation in motor control. , 2010, Annual review of neuroscience.

[31]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[32]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[33]  James F. O'Brien,et al.  Using blur to affect perceived distance and size , 2010, TOGS.

[34]  V. Jayaraman,et al.  Studying sensorimotor integration in insects , 2011, Current Opinion in Neurobiology.

[35]  W. Bobier,et al.  Gain and Movement Time of Convergence-Accommodation in Preschool Children , 2004, Optometry and vision science : official publication of the American Academy of Optometry.

[36]  Sumio Yano,et al.  A study of visual fatigue and visual comfort for 3D HDTV/HDTV images , 2002 .

[37]  M. Webster,et al.  Visual Discomfort and Natural Image Statistics , 2010, Perception.

[38]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[39]  A S Eadie,et al.  Modelling adaptation effects in vergence and accommodation after exposure to a simulated Virtual Reality stimulus , 2000, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[40]  W. Charman The eye in focus: accommodation and presbyopia , 2008, Clinical & experimental optometry.

[41]  Alan C. Bovik,et al.  Theory of order statistic filters and their relationship to linear FIR filters , 1989, IEEE Trans. Acoust. Speech Signal Process..

[42]  Alan C. Bovik,et al.  3D Visual Activity Assessment Based on Natural Scene Statistics , 2014, IEEE Transactions on Image Processing.

[43]  Alan C. Bovik,et al.  Fast algorithms for foveated video processing , 2003, IEEE Trans. Circuits Syst. Video Technol..

[44]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[45]  Masaki Emoto,et al.  Two factors in visual fatigue caused by stereoscopic HDTV images , 2004 .

[46]  Marios S. Pattichis,et al.  Foveated video quality assessment , 2002, IEEE Trans. Multim..

[47]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[48]  Do-Kyoung Kwon,et al.  Full-reference quality assessment of stereopairs accounting for rivalry , 2013, Signal Process. Image Commun..

[49]  W. N. Charman,et al.  Pupil Diameter and the Depth-of-field of the Human Eye as Measured by Laser Speckle , 1977 .

[50]  Peter Kauff,et al.  Production Rules for Stereo Acquisition , 2011, Proceedings of the IEEE.

[51]  Kwanghoon Sohn,et al.  Visual fatigue modeling and analysis for stereoscopic video , 2012 .

[52]  John D. Villasenor,et al.  Visibility of wavelet quantization noise , 1997, IEEE Transactions on Image Processing.