Investigating the Relationship between Binocular Disparity, Viewer Discomfort, and Depth Task Performance on Stereoscopic 3D Displays

McIntire, John Paul. Ph.D., Department of Psychology, Human Factors Psychology Program, Wright State University, 2014. Investigating the Relationship between Binocular Disparity, Viewer Discomfort, and Depth Task Performance on Stereoscopic 3D Displays. Stereoscopic 3D (S3D) displays offer the capability to enhance user performance on a variety of depth tasks. However, the benefit derived from viewing S3D depends in part on the magnitude of binocular disparity that is displayed. Surprisingly few studies have directly investigated the relationship between disparity and depth task performance. The studies that have been conducted suggest that a minimum amount of disparity (10-50 arc min) may be needed to improve performance over conditions in which no S3D is present, but it is unclear the extent to which performance might improve with increases in disparity beyond this range. From a human factors perspective, there are compelling reasons for using binocular disparities that are smaller than a strict geometrical interpretation of the scene would require (i.e., microstereopsis); one reason is to make the viewing experience more comfortable. This is important because S3D displays appear to cause a variety of simulator sickness-type problems for as many as 25-50% of users (including eye strain, headache, nausea, etc.). Preliminary evidence on the use of microstereopsis suggests that it does indeed result in a more comfortable and less fatiguing depth percept, particularly if binocular disparity is limited to a maximum of about 60 to 70 arc min (the One Degree Rule). But does microstereopsis also negate the performance benefits of stereopsis? How much can disparities be reduced before performance decrements are noticeable, and how comfortable are these disparities? Is there a stereo “sweet spot” in which both performance and comfort are high? And is this sweet-spot dependent on the particular depth task being tested? Results from a simple 2 degree-of-freedom (DOF) virtual precision object alignment task showed that when averaged across participants, maximum performance was achieved when iii disparity was limited to +/80 or 100 arc min of disparity during a 30 minute session. Performance with S3D cues improved alignment accuracy by up to 80% compared to no stereo cues, though several participants received an inconsistent benefit, and in a few cases, S3D resulted in detrimental performance. The tested magnitudes of disparity limits were also generally comfortable, although a significant correlation between increasing disparity and decreasing comfort was confirmed. Several optometric measures (e.g. stereoacuity, fusion ranges) predicted performance, but not comfort, on S3D displays. Results from a more complex 5 DOF virtual precision object alignment task showed that the best performance was achieved with disparity limits from +/60 to 100 arc min of disparity. Again, the tested magnitudes of disparity limits were generally comfortable, and several optometric measurements predicted performance but not comfort. Overall, the results suggest that the One Degree Rule for stereoscopic disparity limits can be expanded for near-viewing desktop applications. The results also suggest that while camera separations resulting in microstereopsis showed improved performance over no-stereopsis conditions, best performance is achieved with orthostereoscopic or near-orthostereoscopic levels of camera separation. The findings provide little support for Postural Instability Theory, but some support for Cue Conflict Theory, as useful guides for studying and mitigating viewer discomfort and simulator sickness symptoms on stereoscopic 3D display applications.

[1]  Makoto Yoshizawa,et al.  A pilot study on pupillary and cardiovascular changes induced by stereoscopic video movies , 2006, Journal of NeuroEngineering and Rehabilitation.

[2]  Eugenia M. Kolasinski,et al.  Simulator Sickness in Virtual Environments. , 1995 .

[3]  Jessie Y. C. Chen,et al.  Effectiveness of Stereoscopic Displays for Indirect-Vision Driving and Robot Teleoperation , 2010 .

[4]  Wijnand A. IJsselsteijn,et al.  Effects of stereoscopic filming parameters and display duration on the subjective assessment of eye strain , 2000, Electronic Imaging.

[5]  Takashi Shibata,et al.  Visual discomfort with stereo displays: effects of viewing distance and direction of vergence-accommodation conflict , 2011, Electronic Imaging.

[6]  Pirkko Oittinen,et al.  Effect of camera separation on the viewing experience of stereoscopic photographs , 2012, J. Electronic Imaging.

[7]  J. Galen Buckwalter,et al.  Sex differences in mental rotation and spatial rotation in a virtual environment , 2004, Neuropsychologia.

[8]  P. Howarth Oculomotor changes within virtual environments. , 1999, Applied ergonomics.

[9]  John R. Wilson,et al.  Virtual Reality-Induced Symptoms and Effects (VRISE) , 1999, Presence: Teleoperators & Virtual Environments.

[10]  On the Late Invention of the Stereoscope , 1987, Perception.

[11]  Reason Jt Motion sickness: a special case of sensory rearrangement. , 1970, Advancement of science.

[12]  J. Kuze,et al.  Subjective evaluation of visual fatigue caused by motion images , 2008, Displays.

[13]  M. Moseley,et al.  Does stereopsis matter in humans? , 1996, Eye.

[14]  Stephen R. Ellis,et al.  Effect of reduced stereoscopic camera separation on ring placement with a surgical telerobot , 2008, Surgical Endoscopy.

[15]  F. A. Miles,et al.  Changes in the Coupling between Accommodation and Vergence Eye Movements Induced in Human Subjects by Altering the Effective Interocular Separation , 1985, Perception.

[16]  David M. Hoffman,et al.  Consequences of Incorrect Focus Cues in Stereo Displays. , 2008, Journal of the Society for Information Display.

[17]  E. Birch,et al.  The functional significance of stereopsis. , 2010, Investigative ophthalmology & visual science.

[18]  Julie M. Drexler,et al.  Cybersickness is Not Simulator Sickness , 1997 .

[19]  W. Bobier,et al.  Gain changes in the accommodative convergence cross‐link , 1996, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[20]  Nicolas S. Holliman,et al.  Mapping perceived depth to regions of interest in stereoscopic images , 2004, IS&T/SPIE Electronic Imaging.

[21]  Kay M Stanney,et al.  Effects of low stereo acuity on performance, presence and sickness within a virtual environment. , 2006, Applied ergonomics.

[22]  Charles Wheatstone On some remarkable and hitherto unobserved phenomena of binocular vision. , 1962 .

[23]  Michael J. Singer,et al.  Task Performance in Virtual Environments: Stereoscopic Versus Monoscopic Displays and Head-Coupling. , 1995 .

[24]  Justin Plantier,et al.  Short exposure to telestereoscope affects the oculomotor system , 2010, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[25]  Matthieu Poyade,et al.  Influence of Binocular Disparity in Depth Perception Mechanisms in Virtual Environments , 2007, Interacción.

[26]  Randy F. Pausch,et al.  A Literature Survey for Virtual Environments: Military Flight Simulator Visual Systems and Simulator Sickness , 1992, Presence: Teleoperators & Virtual Environments.

[27]  John P. Gildea,et al.  Effects of Display Type on Performance in Virtual Environments. , 1996 .

[28]  Wijnand A. IJsselsteijn,et al.  Reading performance as screening tool for visual complaints from stereoscopic content , 2012, Displays.

[29]  Hang-Bong Kang,et al.  The measurement of eyestrain caused from diverse binocular disparities, viewing time and display sizes in watching stereoscopic 3D content , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[30]  Ingrid Heynderickx,et al.  An exploration of the initial effects of stereoscopic displays on optometric parameters , 2011, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[31]  S. McKee,et al.  The precision of binocular and monocular depth judgments in natural settings. , 2010, Journal of vision.

[32]  Mel Siegel,et al.  Just enough reality: a kinder gentler approach to stereo , 1999, Defense, Security, and Sensing.

[33]  S. Pastoor Human factors of 3D displays in advanced image communications , 1993 .

[34]  K J Ciuffreda,et al.  Adaptation to Optically-Increased Interocular Separation under Naturalistic Viewing Conditions , 1990, Perception.

[35]  F A Miles,et al.  Optically induced changes in the couplings between vergence and accommodation , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[36]  Sarah Sharples,et al.  Virtual reality induced symptoms and effects (VRISE): Comparison of head mounted display (HMD), desktop and projection display systems , 2008, Displays.

[37]  Wijnand A. IJsselsteijn,et al.  Subjective evaluation of stereoscopic images: effects of camera parameters and display duration , 2000, IEEE Trans. Circuits Syst. Video Technol..

[38]  Y. Aitsiselmi,et al.  Using mental rotation to evaluate the benefits of stereoscopic displays , 2009, Electronic Imaging.

[39]  G. Klunder,et al.  AMERICAN OPTOMETRIC ASSOCIATION , 1925 .

[40]  Mark Mon-Williams,et al.  The effect of orientation on prehension movement time , 2007, Experimental Brain Research.

[41]  G. Carlsson,et al.  Topology based data analysis identifies a subgroup of breast cancers with a unique mutational profile and excellent survival , 2011, Proceedings of the National Academy of Sciences.

[42]  Mark Mon-Williams,et al.  Natural problems for stereoscopic depth perception in virtual environments , 1995, Vision Research.

[43]  G. Westheimer Meridional anisotropy in visual processing: implications for the neural site of the oblique effect , 2003, Vision Research.

[44]  Sakuichi Ohtsuka,et al.  P‐35: Individual Differences in the Use of Binocular and Monocular Depth Cues in 3D‐Graphic Environments , 2012 .

[45]  T. Stoffregen,et al.  An ecological Theory of Motion Sickness and Postural Instability , 1991 .

[46]  Masaki Emoto,et al.  Visual comfort/discomfort and visual fatigue caused by stereoscopic HDTV viewing , 2004, IS&T/SPIE Electronic Imaging.

[47]  M. Mon-Williams,et al.  Binocular vision in a virtual world: visual deficits following the wearing of a head‐mounted display , 1993, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[48]  Romain Cousseau,et al.  Is visual fatigue changing the perceived depth accuracy on an autostereoscopic display? , 2011, Electronic Imaging.

[49]  Ramiro Velazquez,et al.  Constraints on human stereo vision for tele-operation , 2011, IX Latin American Robotics Symposium and IEEE Colombian Conference on Automatic Control, 2011 IEEE.

[50]  Wim Vanduffel,et al.  The Radial Bias: A Different Slant on Visual Orientation Sensitivity in Human and Nonhuman Primates , 2006, Neuron.

[51]  Masaki Emoto,et al.  Two factors in visual fatigue caused by stereoscopic HDTV images , 2004 .

[52]  A H Reinhardt-Rutland,et al.  Remote operation: a selective review of research into visual depth perception. , 1996, The Journal of general psychology.

[53]  Shunnan Yang,et al.  Effects of vergence and accommodative responses on viewer's comfort in viewing 3D stimuli , 2011, Electronic Imaging.

[54]  Ronald R. Mourant,et al.  Human Factors Issues in Virtual Environments: A Review of the Literature , 1998, Presence.

[55]  Philippe Fuchs,et al.  Visual Fatigue Reduction for Immersive Stereoscopic Displays by Disparity, Content, and Focus-Point Adapted Blur , 2012, IEEE Transactions on Industrial Electronics.

[56]  John P. McIntire,et al.  Stereoscopic 3D displays and human performance: A comprehensive review , 2014, Displays.

[57]  John P. McIntire,et al.  What is 3D good for? A review of human performance on stereoscopic 3D displays , 2012, Defense + Commercial Sensing.

[58]  Frouke Hermens,et al.  Visual and Haptic Matching of Perceived Orientations of Lines , 2003, Perception.

[59]  Gary E. Riccio,et al.  Visually Induced Motion Sickness in Virtual Environments , 1992, Presence: Teleoperators & Virtual Environments.

[60]  Steven P. Williams,et al.  New computational control techniques and increased understanding for stereo 3-D displays , 1990, Other Conferences.

[61]  Timothy R. Fricke,et al.  Stereopsis, stereotests, and their relation to vision screening and clinical practice , 1997 .

[62]  Tohru Ifukube,et al.  Effects of an Eyeglass-free 3-D Display on the Human Visual System , 2003, Japanese Journal of Ophthalmology.

[63]  Jason G Russi,et al.  Effects of Stereoscopic 3D Digital Radar Displays on Air Traffic Controller Performance , 2013 .

[64]  Colin Ware,et al.  Dynamic adjustment of stereo display parameters , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[65]  Simon P. DiMaio,et al.  The da Vinci Surgical System , 2011 .

[66]  Andrea Bosco,et al.  Gender effects in spatial orientation: cognitive profiles and mental strategies , 2004, Applied cognitive psychology.

[67]  Barbara Froner Stereoscopic 3D technologies for accurate depth tasks : a theoretical and empirical study , 2011 .

[68]  Filippo Speranza,et al.  Effect of disparity and motion on visual comfort of stereoscopic images , 2006, Electronic Imaging.

[69]  Michael A Mollenhauer,et al.  Simulator Adaptation Syndrome Literature Review , 2004 .

[70]  A. B. Nutt Binocular vision. , 1945, The British orthoptic journal.

[71]  John P. McIntire,et al.  Clinically Normal Stereopsis Does Not Ensure a Performance Benefit from Stereoscopic 3D Depth Cues , 2014 .

[72]  Matthias Wöpking,et al.  Viewing comfort with stereoscopic pictures : an experimental study on the subjective effects of disparity magnitude and depth of focus , 1995 .

[73]  Makoto Okui,et al.  Geometrical analysis of puppet-theater and cardboard effects in stereoscopic HDTV images , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[74]  David M. Hoffman,et al.  The zone of comfort: Predicting visual discomfort with stereo displays. , 2011, Journal of vision.

[75]  G. Watanabe,et al.  [da Vinci surgical system]. , 2014, Kyobu geka. The Japanese journal of thoracic surgery.

[76]  Graham R Jones,et al.  Controlling perceived depth in stereoscopic images , 2001, IS&T/SPIE Electronic Imaging.

[77]  Ichiro Yuyama,et al.  A study on the relationship between shooting conditions and cardboard effect of stereoscopic images , 2000, IEEE Trans. Circuits Syst. Video Technol..

[78]  S. Appelle Perception and discrimination as a function of stimulus orientation: the "oblique effect" in man and animals. , 1972, Psychological bulletin.

[79]  Gregg Podnar,et al.  Geometry of binocular imaging , 1994, Electronic Imaging.

[80]  E. Peinsipp-Byma,et al.  Evaluation of stereoscopic 3D displays for image analysis tasks , 2009, Electronic Imaging.

[81]  R. Jones,et al.  Anomalies of disparity detection in the human visual system. , 1977, The Journal of physiology.

[82]  R. Stone,et al.  Evaluation of 3D Television: Impact on Depth Perception , 2012 .

[83]  Wei-Cheng Chao,et al.  65.3: An Ergonomic Evaluation of Stereoscopic and Deadzone‐free Autostereoscopic Three‐dimensional Displays , 2012 .

[84]  Laurent Blondé,et al.  Visual fatigue versus eye-movements , 2012, Electronic Imaging.

[85]  Robert Patterson,et al.  Review Paper: Human factors of stereo displays: An update , 2009 .

[86]  Nam Ju Moon,et al.  Clinical evaluation of accommodation and ocular surface stability relavant to visual asthenopia with 3D displays , 2014, BMC Ophthalmology.

[87]  David M Johnson,et al.  Introduction to and Review of Simulator Sickness Research , 2005 .

[88]  H Ohzu,et al.  Accommodative responses to stereoscopic three-dimensional display. , 1997, Applied optics.

[89]  W. Richards,et al.  Anomalous stereoscopic depth perception. , 1971, Journal of the Optical Society of America.

[90]  Simon K. Rushton,et al.  Binocular vision in a bi-ocular world: new-generation head-mounted displays avoid causing visual deficit , 1994 .

[91]  Ahmet M. Kondoz,et al.  Sensitivity Analysis of the Human Visual System for Depth Cues in Stereoscopic 3-D Displays , 2011, IEEE Transactions on Multimedia.

[92]  Wa Wijnand IJsselsteijn,et al.  Visual discomfort in stereoscopic displays: a review , 2007, Electronic Imaging.

[93]  Marcel P. Lucassen,et al.  Visual comfort of binocular and 3D displays , 2001, IS&T/SPIE Electronic Imaging.

[94]  Anders Persson,et al.  Evaluation of quality of experience in interactive 3D visualization: methodology and results , 2012, Electronic Imaging.

[95]  B. Anderson Depth perception , 2008 .

[96]  A. Solimini Are There Side Effects to Watching 3D Movies? A Prospective Crossover Observational Study on Visually Induced Motion Sickness , 2013, PloS one.

[97]  Masako Omori,et al.  Accommodative load for stereoscopic displays , 2005, IS&T/SPIE Electronic Imaging.

[98]  M. Treisman Motion sickness: an evolutionary hypothesis. , 1977, Science.

[99]  Yasuichi Murai,et al.  A Case Report of Manifest Esotropia After Viewing Anagryph Stereoscopic Movie , 1988 .

[100]  Wa Wijnand IJsselsteijn,et al.  Measuring visual fatigue and visual discomfort associated with 3‐D displays , 2010 .

[101]  Mel W. Siegel,et al.  Just enough reality: comfortable 3-D viewing via microstereopsis , 2000, IEEE Trans. Circuits Syst. Video Technol..

[102]  T. Mitsuhashi,et al.  Evaluation of stereoscopic picture quality with CFF. , 1996, Ergonomics.

[103]  Wijnand A. IJsselsteijn,et al.  Susceptibility to Visual Discomfort of 3-D Displays by Visual Performance Measures , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[104]  Jessie Y C Chen,et al.  Utility of stereoscopic displays for indirect-vision driving and robot teleoperation , 2014, Ergonomics.

[105]  Kwanghoon Sohn,et al.  Depth adjustment for stereoscopic images and subjective preference evaluation , 2011, J. Electronic Imaging.

[106]  Wijnand A. Ijsselsteijn,et al.  Evaluating stereoscopic displays: both efficiency measures and perceived workload sensitive to manipulations in binocular disparity , 2011, Electronic Imaging.

[107]  Mel Siegel,et al.  Kinder, gentler stereo , 1999, Electronic Imaging.

[108]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[109]  Jennifer A. Ehrlich Simulator sickness and HMD configurations , 1997, Other Conferences.

[110]  E. C. Regan Some evidence of adaptation to immersion in virtual reality , 1995 .

[111]  Paul McCrory,et al.  Validity and reliability of the Nintendo Wii Balance Board for assessment of standing balance. , 2010, Gait & posture.

[112]  Jari Takatalo,et al.  Simulator sickness in virtual display gaming: a comparison of stereoscopic and non-stereoscopic situations , 2006, Mobile HCI.

[113]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[114]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[115]  Peter A. Howarth,et al.  Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations , 2008, Displays.

[116]  Joseph J. LaViola,et al.  A discussion of cybersickness in virtual environments , 2000, SGCH.

[117]  Junle Wang,et al.  Quantifying how the combination of blur and disparity affects the perceived depth , 2011, Electronic Imaging.

[118]  Robert S. Kennedy,et al.  Postural Stability and its Relation to Simulator Sickness , 1994 .

[119]  I. Heynderickx,et al.  Measuring visual discomfort associated with 3D displays , 2009, Electronic Imaging.

[120]  Louis B. Rosenberg The effect of interocular distance upon operator performance using stereoscopic displays to perform virtual depth tasks , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[121]  Zygmunt Pizlo,et al.  Issues in the design of studies to test the effectiveness of stereo imaging , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[122]  J. Reason Motion sickness: a special case of sensory rearrangement. , 1970, Advancement of science.

[123]  Ammiel Alcalay A little history , 2012 .

[124]  Steve T. Wright,et al.  Optometric Measurements Predict Performance but not Comfort on a Virtual Object Placement Task with a Stereoscopic 3D Display , 2014 .