The impact of video characteristics and subtitles on visual comfort of 3D TV

Some viewers of stereoscopic content experience visual discomfort that can be induced or intensified by certain video characteristics such as fast in-scene motion, large changes in disparity and depth discontinuities caused by subtitles. An experiment was carried out to determine the impact of these video characteristics in terms of visual comfort via different measurement methods. Two 3-D movies of approximately 15 min each, both with and without subtitles, were assessed in terms of visual comfort via a continuous assessment and retrospective questionnaires. Analysis of the questionnaire data revealed that subtitles negatively affect how viewers watch stereoscopic movie in terms of general visual comfort items as well as in terms of double vision and sharpness. Via the questionnaires, participants reported that their visual comfort assessment depended primarily on the motion and (changes in) depth in the video content. The scores of the continuous assessment were directly correlated to video characteristics that were derived from the 3-D movies. In line with the questionnaire results, analysis of the continuous assessment scores revealed that visual comfort could be predicted from a linear combination of these video characteristics per scene, yet more complex models are required to extend the comfort prediction to entire movies, incorporating different scenes.

[1]  Marja Salmimaa,et al.  5.4: Subtitles in Short 3‐D Movies , 2009 .

[2]  David M. Hoffman,et al.  Perceptual Issues in Stereoscopic Signal Processing , 2011, IEEE Transactions on Broadcasting.

[3]  Chris Varekamp,et al.  Challenges in 3DTV image processing , 2007, Electronic Imaging.

[4]  V. Goffaux,et al.  The horizontal tuning of face perception relies on the processing of intermediate and high spatial frequencies. , 2011, Journal of vision.

[5]  Wijnand A. IJsselsteijn,et al.  A survey of perceptual evaluations and requirements of three-dimensional TV , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  G. Mitchell,et al.  Validity and Reliability of the Revised Convergence Insufficiency Symptom Survey in Children Aged 9 to 18 Years , 2003, Optometry and vision science : official publication of the American Academy of Optometry.

[7]  David M. Hoffman,et al.  The zone of comfort: Predicting visual discomfort with stereo displays. , 2011, Journal of vision.

[8]  Wa Wijnand IJsselsteijn,et al.  Evaluation of stereoscopic stills : beyond the 2-D quality model , 2008 .

[9]  Neil A. Dodgson,et al.  Three-Dimensional Displays: A Review and Applications Analysis , 2011, IEEE Transactions on Broadcasting.

[10]  H Bedell,et al.  Vergence Facility and Target Type , 1998, Optometry and vision science : official publication of the American Academy of Optometry.

[11]  I. Heynderickx,et al.  Measuring visual discomfort associated with 3D displays , 2009, Electronic Imaging.

[12]  Alexander Toet,et al.  Visual comfort of binocular and 3D displays , 2004 .

[13]  V. M. Belous.  Review of luminescence studies of mechanisms of spectral sensitization and supersensitization : Chemically sensitized emulsions , 1999 .

[14]  E. Peli,et al.  The visual effects of head-mounted display (HMD) are not distinguishable from those of desk-top computer display , 1998, Vision Research.

[15]  D. Pickwell,et al.  Pickwellʼs Binocular Vision Anomalies. Investigation and Treatment. 3rd ed , 1997 .

[16]  Jari Takatalo,et al.  Measuring stereoscopic image quality experience with interpretation based quality methodology , 2008, Electronic Imaging.

[17]  T. Freeman,et al.  Motion perception during sinusoidal smooth pursuit eye movements: signal latencies and non-linearities. , 2008, Journal of vision.

[18]  Ingrid Heynderickx,et al.  An exploration of the initial effects of stereoscopic displays on optometric parameters , 2011, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[19]  Wa Wijnand IJsselsteijn,et al.  Measuring visual fatigue and visual discomfort associated with 3‐D displays , 2010 .

[20]  Patrick Le Callet,et al.  Quality Assessment of Stereoscopic Images , 2008, EURASIP J. Image Video Process..

[21]  Wijnand A. IJsselsteijn,et al.  Evaluation of Stereoscopic Images: Beyond 2D Quality , 2011, IEEE Transactions on Broadcasting.

[22]  de G. Haan.  Digital video post processing , 2006 .

[23]  J. Sheedy,et al.  Is all Asthenopia the Same? , 2003, Optometry and vision science : official publication of the American Academy of Optometry.

[24]  E. Peli.  Optometric and Perceptual Issues with Head-mounted Displays , 2010 .

[25]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[26]  Philip J. Corriveau,et al.  Psychovisual aspects of viewing stereoscopic video sequences , 1998, Electronic Imaging.

[27]  Filippo Speranza,et al.  Effect of disparity and motion on visual comfort of stereoscopic images , 2006, Electronic Imaging.

[28]  Wijnand A. IJsselsteijn,et al.  Visual discomfort of 3D TV: Assessment methods and modeling , 2011, Displays.

[29]  Masaki Emoto,et al.  Two factors in visual fatigue caused by stereoscopic HDTV images , 2004 .

[30]  Wijnand A. IJsselsteijn,et al.  Susceptibility to Visual Discomfort of 3-D Displays by Visual Performance Measures , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  F. Okano,et al.  Repeated vergence adaptation causes the decline of visual functions in watching stereoscopic television , 2005, Journal of Display Technology.

[32]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[33]  J. Kuze,et al.  Subjective evaluation of visual fatigue caused by motion images , 2008, Displays.

[34]  Dominik Strohmeier,et al.  Sharp, bright, three-dimensional: open profiling of quality for mobile 3DTV coding methods , 2010, Electronic Imaging.

[35]  Patrick Le Callet,et al.  New stereoscopic video shooting rule based on stereoscopic distortion parameters and comfortable viewing zone , 2011, Electronic Imaging.

[36]  K. M. Blackwood.  Displays , 2000, Encyclopedia of Evolutionary Psychological Science.

[37]  Wa Wijnand IJsselsteijn,et al.  Visual discomfort in stereoscopic displays: a review , 2007, Electronic Imaging.

[38]  Sumio Yano,et al.  A study of visual fatigue and visual comfort for 3D HDTV/HDTV images , 2002 .

[39]  Romain Cousseau,et al.  Is visual fatigue changing the perceived depth accuracy on an autostereoscopic display? , 2011, Electronic Imaging.

[40]  Rolph E. Anderson,et al.  Multivariate Data Analysis (7th ed. , 2009 .

[41]  Masaki Emoto,et al.  Changes in fusional vergence limit and its hysteresis after viewing stereoscopic TV , 2004 .