Gaze-contingent depth of field in realistic scenes: the user experience

Computer-generated objects presented on a display typically have the same focal distance regardless of the monocular and binocular depth cues used to portray a 3D scene. This is because they are presented on a flat screen display that has a fixed physical location. In a stereoscopic 3D display, accommodation (focus) of the eyes should always be at the distance of the screen for clear vision regardless of the depth portrayed; this fixed accommodation conflicts with vergence eye movements that the user must make to fuse stimuli located off the screen. This is known as accommodation-vergence conflict and is detrimental for user experience of stereoscopic virtual environments (VE), as it can cause visual discomfort and diplopia during use of a stereoscopic display. It is believed that, by artificially simulating focal blur and natural accommodation, it is possible to compensate for the vergence-accommodation conflict and alleviate these symptoms. We hypothesized that it is possible to compensate for conflict with a fixed accommodation cue by adding simulated focal blur according to instantaneous fixation. We examined gaze-contingent depth of field (DOF) when used in stereoscopic and non-stereoscopic 3D displays. We asked our participants to compare different conditions in terms of depth perception, image quality and viewing comfort. As expected, we found that monocular DOF gave a stronger impression of depth than no depth of field, stereoscopic cues were stronger than any kind of monocular cues, but adding depth of field to stereo displays did not enhance depth impressions. The opposite was true for image comfort. People thought that DOF impaired image quality in monocular viewing. We also observed that comfort was affected by DOF and display mode in similar fashion as image quality. However, the magnitude of the effects of DOF simulation on image quality depended on whether people associated image quality with depth or not. These results suggest that studies evaluating DOF effectiveness need to consider the type of task, type of image and questions asked.

[1]  Peter A. Howarth,et al.  Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations , 2008, Displays.

[2]  Brian A. Barsky,et al.  Algorithms for rendering depth of field effects in computer graphics , 2008 .

[3]  Paul Milgram,et al.  Perceptual issues in augmented reality , 1996, Electronic Imaging.

[4]  Thomas J. Aitkin.  Elements of Physiology , 1839, The British and foreign medical review.

[5]  Mark Mon-Williams,et al.  Natural problems for stereoscopic depth perception in virtual environments , 1995, Vision Research.

[6]  Paul B Hibbard,et al.  Visual discomfort and blur. , 2011, Journal of vision.

[7]  Paul Sharkey,et al.  Operator performance evaluation of controlled depth of field in a stereographically displayed virtual environment , 2001, IS&T/SPIE Electronic Imaging.

[8]  James P. C. Southall,et al.  Optical system of the eye. , 1924 .

[9]  Ian van der Linde.  Multiresolution image compression using image foveation and simulated depth of field for stereoscopic displays , 2004 .

[10]  Donald P. Greenberg,et al.  Perceiving spatial relationships in computer-generated images , 1992, IEEE Computer Graphics and Applications.

[11]  C. A. Burbeck,et al.  Occlusion edge blur: a cue to relative visual depth. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  M. Ernst,et al.  Focus cues affect perceived depth. , 2005, Journal of vision.

[13]  Marcel P. Lucassen,et al.  Visual comfort of binocular and 3D displays , 2001, IS&T/SPIE Electronic Imaging.

[14]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[15]  Randima Fernando,et al.  The CG Tutorial: The Definitive Guide to Programmable Real-Time Graphics , 2003 .

[16]  Jirí Zára,et al.  Fast depth of field rendering with surface splatting , 2003, Proceedings Computer Graphics International 2003.

[17]  R. D. Watkins,et al.  THE OPTICAL SYSTEM OF THE EYE , 1970 .

[18]  Mark Packer,et al.  Depth of focus. , 2008, Ophthalmology.

[19]  Mark Mon-Williams,et al.  Binocular Virtual Reality Displays: When Problems Do and Don't Occur , 1998, Hum. Factors.

[20]  Martin S. Banks,et al.  A stereo display prototype with multiple focal distances , 2004, ACM Trans. Graph..

[21]  R. Hetherington.  The Perception of the Visual World , 1952 .

[22]  Peter Willemsen,et al.  Does the Quality of the Computer Graphics Matter when Judging Distances in Visually Immersive Environments? , 2004, Presence: Teleoperators & Virtual Environments.

[23]  Robert S. Allison,et al.  Real-time simulation of visual defects with gaze-contingent display , 2008, ETRA.

[24]  Anatole Lécuyer,et al.  Using an Eye-Tracking System to Improve Camera Motions and Depth-of-Field Blur Effects in Virtual Environments , 2008, 2008 IEEE Virtual Reality Conference.

[25]  Philippe Fuchs,et al.  Real-time adaptive blur for reducing eye strain in stereoscopic displays , 2012, TAP.

[26]  Jung Hong Chuang.  Level of Detail for 3D Graphics , 2002 .

[27]  Nassir Navab,et al.  The effect of out-of-focus blur on visual discomfort when using stereo displays , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[28]  Christina Villarruel.  Computer Graphics and Human Depth Perception with Gaze-Contingent Depth of Field , 2011 .

[29]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Makoto Okui,et al.  Geometrical analysis of puppet-theater and cardboard effects in stereoscopic HDTV images , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Anatole Lécuyer,et al.  Depth-of-Field Blur Effects for First-Person Navigation in Virtual Environments , 2007, IEEE Computer Graphics and Applications.

[32]  Robert van Liere,et al.  Fast perception-based depth of field rendering , 2000, VRST '00.

[33]  Robert S. Allison,et al.  Detection of the depth order of defocused images , 2005, Vision Research.