Overview of Measurement Methods for Factors Affecting the Human Visual System in 3D Displays

Three-dimensional (3D) display systems are widely used nowadays, and their psychophysiological effects on human health have been investigated in detail. However, due to recent advances in 3D display technology, such as (super) multiview display or holography, there is a clear and pressing need to develop a new measurement method for determining optimal viewing parameters. Depending on the display system in question, virtual objects with depth information may present different properties to the human visual system and thus are perceived differently. The methods to measure the factors that affect human health in 3D displays need to be thoroughly reviewed in order to further investigate these characteristics and determine optimal viewing parameters. In this paper, we review various measurement methods that have been proposed to examine the effects of 3D stimuli on the human visual system. We provide an overview of recent advances in 3D techniques by relating them with human factors, primarily focusing on subjective and objective measurement methods, to ensure that human-friendly 3D content and displays will benefit from recent technical advances.

[1]  Westgate Road,et al.  Photoplethysmography and its application in clinical physiological measurement , 2007 .

[2]  Masayuki Nakajima,et al.  Study of asthenopia caused by the viewing of stereoscopic images: measurement by MEG and other devices , 2006, Electronic Imaging.

[3]  Bin Wang,et al.  Modeling and Performance Limits of a Large Aperture High-Resolution Wavefront Control System Based on a Liquid Crystal Spatial Light Modulator , 2007 .

[4]  Marek Skeren,et al.  Spatial holograms in measuring of eye vergence and accommodation dynamics , 2011, 2011 E-Health and Bioengineering Conference (EHB).

[5]  Martin S. Banks,et al.  A stereo display prototype with multiple focal distances , 2004, SIGGRAPH 2004.

[6]  Laurie M. Wilcox,et al.  On the typical development of stereopsis: Fine and coarse processing , 2013, Vision Research.

[7]  U. Bergqvist Visual Display Terminal work — A perspective on long-term changes and discomforts , 1995 .

[8]  Celestine A. Ntuen,et al.  Comparison between 2-D & 3-D using an autostereoscopic display: The effects of viewing field and illumination on performance and visual fatigue , 2009 .

[9]  J. Kuze,et al.  Subjective evaluation of visual fatigue caused by motion images , 2008, Displays.

[10]  Thomson Wd,et al.  Eye problems and visual display terminals—the facts and the fallacies , 1998 .

[11]  V. Michael Bove,et al.  Visual Perception and Holographic Displays , 2013 .

[12]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[13]  Marieke E. Thurlings,et al.  Controlling a Tactile ERP–BCI in a Dual Task , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[14]  Ingrid Heynderickx,et al.  32.2: Effect of Crosstalk in Multi‐View Autostereoscopic 3D Displays on Perceived Image Quality , 2007 .

[15]  Ismo Rakkolainen,et al.  A Survey of 3DTV Displays: Techniques and Technologies , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Yue Gong,et al.  Stereoscopic visual fatigue assessment and modeling , 2014, Electronic Imaging.

[17]  David J. Fleet,et al.  Human cortical activity correlates with stereoscopic depth perception. , 2001, Journal of neurophysiology.

[18]  Peter A. Howarth,et al.  Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations , 2008, Displays.

[19]  Robert S. Allison,et al.  The Effect of Crosstalk on the Perceived Depth From Disparity and Monocular Occlusions , 2011, IEEE Transactions on Broadcasting.

[20]  Anders Persson,et al.  Evaluation of quality of experience in interactive 3D visualization: methodology and results , 2012, Electronic Imaging.

[21]  F. Okano,et al.  Repeated vergence adaptation causes the decline of visual functions in watching stereoscopic television , 2005, Journal of Display Technology.

[22]  Bahram Javidi,et al.  Methods for Displaying Three-Dimensional Images , 2006, Proceedings of the IEEE.

[23]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[24]  A. Parker Binocular depth perception and the cerebral cortex , 2007, Nature Reviews Neuroscience.

[25]  Min-Chul Park,et al.  Evaluation of Human Factors for the Next-Generation Displays , 2013 .

[26]  Andrew P. Wood,et al.  3D electronic holography display system using a 100-megapixel spatial light modulator , 2004, SPIE Optical Systems Design.

[27]  Marcus Barkowsky,et al.  How visual fatigue and discomfort impact 3D-TV quality of experience: a comprehensive review of technological, psychophysical, and psychological factors , 2013, annals of telecommunications - annales des télécommunications.

[28]  Anders Persson,et al.  Subjective evaluation of user experience in interactive 3D visualization in a medical context , 2012, Medical Imaging.

[29]  Ching-Torng Lin,et al.  Effects of e-map format and sub-windows on driving performance and glance behavior when using an in-vehicle navigation system. , 2010 .

[30]  Junle Wang,et al.  Study of depth bias of observers in free viewing of still stereoscopic synthetic stimuli , 2012 .

[31]  Hiroshi Yoshikawa,et al.  Real-time holographic display: improvements using a multichannel acousto-optic modulator and holographic optical elements , 1991, Electronic Imaging.

[32]  Sumio Yano,et al.  Visual fatigue caused by stereoscopic images and the search for the requirement to prevent them: A review , 2012, Displays.

[33]  Stefan Winkler,et al.  Stereo/multiview picture quality: Overview and recent advances , 2013, Signal Process. Image Commun..

[34]  Richard A Eagle,et al.  Reversed stereo depth and motion direction with anti-correlated stimuli , 2000, Vision Research.

[35]  Tomasz Kozacki,et al.  Extended viewing angle holographic display system with tilted SLMs in a circular configuration. , 2012, Applied optics.

[36]  Philip J. Corriveau,et al.  Stereoscopic Viewing and Reported Perceived Immersion and Symptoms , 2012, Optometry and vision science : official publication of the American Academy of Optometry.

[37]  Rosemarie J. E. Rajae-Joordens,et al.  MEASURING EXPERIENCES IN GAMING AND TV APPLICATIONS Investigating the Added Value of a Multi-View Auto-Stereoscopic 3D Display , 2008 .

[38]  Hyung-Chul O. Li Human Factor Research on the Measurement of Subjective Three Dimensional Fatigue , 2010 .

[39]  Wijnand A. IJsselsteijn,et al.  Susceptibility to Visual Discomfort of 3-D Displays by Visual Performance Measures , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  Yasuhiro Takaki,et al.  Accommodation measurements of horizontally scanning holographic display. , 2012, Optics express.

[41]  Sheue-Ling Hwang,et al.  Human factor study on the crosstalk of multiview autostereoscopic displays , 2010, Defense + Commercial Sensing.

[42]  David M. Hoffman,et al.  The zone of comfort: Predicting visual discomfort with stereo displays. , 2011, Journal of vision.

[43]  Philippe Fuchs,et al.  Vergence tracking: a tool to assess oculomotor performance in stereoscopic displays , 2012 .

[44]  S. Tremblay,et al.  Using near infrared spectroscopy and heart rate variability to detect mental overload , 2014, Behavioural Brain Research.

[45]  W D Thomson,et al.  Eye problems and visual display terminals—the facts and the fallacies , 1998, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[46]  Min-Chul Park,et al.  Effect of mental fatigue caused by mobile 3D viewing on selective attention: an ERP study. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[47]  Jodi Forlizzi,et al.  Psycho-physiological measures for assessing cognitive load , 2010, UbiComp.

[48]  Robert T Held,et al.  A guide to stereoscopic 3D displays in medicine. , 2011, Academic radiology.

[49]  Wijnand A. IJsselsteijn,et al.  The impact of video characteristics and subtitles on visual comfort of 3D TV , 2013, Displays.

[50]  Brodie Stanfield,et al.  Stereoscopic 3D video games and their effects on engagement , 2012, Electronic Imaging.

[51]  Joseph T. Coyne,et al.  Applying Real Time Physiological Measures of Cognitive Load to Improve Training , 2009, HCI.

[52]  Ja-Ling Wu,et al.  Quality Assessment of Stereoscopic 3D Image Compression by Binocular Integration Behaviors , 2014, IEEE Transactions on Image Processing.

[53]  Chaminda T. E. R. Hewage,et al.  Quality of experience for 3D video streaming , 2013, IEEE Communications Magazine.

[54]  Andrew J. Woods,et al.  Crosstalk in stereoscopic displays: a review , 2012, J. Electronic Imaging.

[55]  Y. Takaki,et al.  Super multi-view display with a lower resolution flat-panel display. , 2011, Optics express.

[56]  Hee-Sun Lee,et al.  The Effect of Two-dimensional and Stereoscopic Presentation on Middle School Students’ Performance of Spatial Cognition Tasks , 2010 .

[57]  D Mutter,et al.  Stereoscopic vision provides a significant advantage for precision robotic laparoscopy , 2004, The British journal of surgery.

[58]  Masaki Emoto,et al.  Visual comfort/discomfort and visual fatigue caused by stereoscopic HDTV viewing , 2004, IS&T/SPIE Electronic Imaging.

[59]  Jari Takatalo,et al.  Subjective experiences of watching stereoscopic Avatar and U2 3D in a cinema , 2012, J. Electronic Imaging.

[60]  Bernard Gilmartin,et al.  Dynamic Measurement of Accommodation and Pupil Size Using the Portable Grand Seiko FR-5000 Autorefractor , 2006, Optometry and vision science : official publication of the American Academy of Optometry.

[61]  John P. McIntire,et al.  What is 3D good for? A review of human performance on stereoscopic 3D displays , 2012, Defense + Commercial Sensing.

[62]  Sylvain Duchêne,et al.  Adapting stereoscopic movies to the viewing conditions using depth-preserving and artifact-free novel view synthesis , 2011, Electronic Imaging.

[63]  Stephan Reichelt,et al.  Depth cues in human visual perception and their realization in 3D displays , 2010, Defense + Commercial Sensing.

[64]  Yong Man Ro,et al.  fMRI analysis of excessive binocular disparity on the human brain , 2014, Int. J. Imaging Syst. Technol..

[65]  Daniel P. J. Bruneau,et al.  A self-analysis of the NASA-TLX workload measure , 2007, Ergonomics.

[66]  Brendan Z. Allison,et al.  Workload assessment of computer gaming using a single-stimulus event-related potential paradigm , 2008, Biological Psychology.

[67]  Keetaek Kham,et al.  Measurement of 3D Visual Fatigue Using Event-Related Potential (ERP): 3D Oddball Paradigm , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[68]  Peter Kauff,et al.  Production Rules for Stereo Acquisition , 2011, Proceedings of the IEEE.

[69]  Min Cheol Whang,et al.  Autonomic Nervous System Responses Can Reveal Visual Fatigue Induced by 3D Displays , 2013, Sensors.

[70]  Jian-Chiun Liou,et al.  Low Crosstalk Multi-View Tracking 3-D Display of Synchro-Signal LED Scanning Backlight System , 2011, Journal of Display Technology.

[71]  Bahram Javidi,et al.  Three-Dimensional Television, Video and Display Technology , 2002 .

[72]  Sung-Wook Min,et al.  Three-dimensional display technologies of recent interest: principles, status, and issues [Invited]. , 2011, Applied optics.

[73]  Shunnan Yang,et al.  Effects of vergence and accommodative responses on viewer's comfort in viewing 3D stimuli , 2011, Electronic Imaging.

[74]  Yongtian Wang,et al.  Study on basic problems in real-time 3D holographic display , 2013, Defense, Security, and Sensing.

[75]  L. Onural,et al.  State of the Art in Holographic Displays: A Survey , 2010, Journal of Display Technology.

[76]  Takashi Shibata,et al.  Visual discomfort with stereo displays: effects of viewing distance and direction of vergence-accommodation conflict , 2011, Electronic Imaging.

[77]  Matthew W. Miller,et al.  A novel approach to the physiological measurement of mental workload. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[78]  Sumio Yano,et al.  A study of visual fatigue and visual comfort for 3D HDTV/HDTV images , 2002 .

[79]  Atsuo Murata,et al.  Evaluation of mental fatigue using feature parameter extracted from event-related potential , 2002 .

[80]  Kang Ryoung Park,et al.  The comparative measurements of eyestrain caused by 2D and 3D displays , 2010, IEEE Transactions on Consumer Electronics.

[81]  R. Rajae-Joordens Measuring Experiences in Gaming and TV Applications , 2008 .

[82]  Kwanghoon Sohn,et al.  Effect of Vergence–Accommodation Conflict and Parallax Difference on Binocular Fusion for Random Dot Stereogram , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[83]  R. Häussler,et al.  Large holographic displays for real-time applications , 2008, SPIE OPTO.

[84]  Craig A. Peters,et al.  1510 COMPARISON OF 3D STEREOSCOPE VS. STANDARD 2D LAPAROSCOPE FOR PERFORMANCE OF TWO STANDARD LAPAROSCOPIC TASKS BY UROLOGY RESIDENTS , 2012 .

[85]  Wa Wijnand IJsselsteijn,et al.  Measuring visual fatigue and visual discomfort associated with 3‐D displays , 2010 .

[86]  N A Dodgson,et al.  Analysis of the viewing zone of the Cambridge autostereoscopic display. , 1996, Applied optics.

[87]  Min-Chul Park,et al.  SSVEP and ERP measurement of cognitive fatigue caused by stereoscopic 3D , 2012, Neuroscience Letters.

[88]  DH Hubel,et al.  Psychophysical evidence for separate channels for the perception of form, color, movement, and depth , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[89]  A. Pope,et al.  Biocybernetic system evaluates indices of operator engagement in automated task , 1995, Biological Psychology.

[90]  Ji-Sang Yoo,et al.  Qualitative analysis of individual and composite content factors of stereoscopic 3D video causing visual discomfort , 2013, Displays.

[91]  Neil A. Dodgson,et al.  Three-Dimensional Displays: A Review and Applications Analysis , 2011, IEEE Transactions on Broadcasting.

[92]  Martin S Banks,et al.  Visual discomfort and the temporal properties of the vergence-accommodation conflict , 2012, Electronic Imaging.

[93]  Alexander Toet,et al.  Visual comfort of binocular and 3D displays , 2004 .

[94]  M. Whang,et al.  Does visual fatigue from 3D displays affect autonomic regulation and heart rhythm? , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[95]  T. Matsuishi,et al.  Photosensitive Seizures Provoked While Viewing “Pocket Monsters,” a Made‐for‐Televison Animation Program in Japan , 1998, Epilepsia.

[96]  Jung-Hoon Lee,et al.  Individual variation in 3D visual fatigue caused by stereoscopic images , 2012, IEEE Transactions on Consumer Electronics.

[97]  Min-Chul Park,et al.  International Journal of Human-computer Interaction Performance Comparison of a Ssvep Bci Task by Individual Stereoscopic 3d Susceptibility , 2022 .

[98]  Shigeru Chiba,et al.  Independent Component Analysis of Finger Photoplethysmography for Evaluating Effects of Visually-Induced Motion Sickness , 2007, HCI.

[99]  Robert J. Barry,et al.  Excess beta activity in children with attention-deficit/hyperactivity disorder: an atypical electrophysiological group , 2001, Psychiatry Research.

[100]  Yasuhiro Takaki Holographic 3D display using MEMS spatial light modulator , 2012, Defense, Security, and Sensing.