Dynamic lens and monovision 3D displays to improve viewer comfort

Stereoscopic 3D (S3D) displays provide an additional sense of depth compared to non-stereoscopic displays by sending slightly different images to the two eyes. But conventional S3D displays do not reproduce all natural depth cues. In particular, focus cues are incorrect causing mismatches between accommodation and vergence: The eyes must accommodate to the display screen to create sharp retinal images even when binocular disparity drives the eyes to converge to other distances. This mismatch causes visual discomfort and reduces visual performance. We propose and assess two new techniques that are designed to reduce the vergence-accommodation conflict and thereby decrease discomfort and increase visual performance. These techniques are much simpler to implement than previous conflict-reducing techniques. The first proposed technique uses variable-focus lenses between the display and the viewer's eyes. The power of the lenses is yoked to the expected vergence distance thereby reducing the mismatch between vergence and accommodation. The second proposed technique uses a fixed lens in front of one eye and relies on the binocularly fused percept being determined by one eye and then the other, depending on simulated distance. We conducted performance tests and discomfort assessments with both techniques and compared the results to those of a conventional S3D display. The first proposed technique, but not the second, yielded clear improvements in performance and reductions in discomfort. This dynamic-lens technique therefore offers an easily implemented technique for reducing the vergence-accommodation conflict and thereby improving viewer experience.

[1]  DOUGLAS SHIRACHI,et al.  Dynamic Measures of Vergence Accommodation , 1977, American journal of optometry and physiological optics.

[2]  Masaki Emoto,et al.  Two factors in visual fatigue caused by stereoscopic HDTV images , 2004 .

[3]  Felix Wichmann,et al.  The psychometric function: II. Bootstrap-based confidence intervals and sampling , 2001, Perception & psychophysics.

[4]  Jin Liu,et al.  Eye and gaze tracking for visually controlled interactive stereoscopic displays , 1999, Signal Process. Image Commun..

[5]  Sheng Liu,et al.  A Novel Prototype for an Optical See-Through Head-Mounted Display with Addressable Focus Cues , 2010, IEEE Transactions on Visualization and Computer Graphics.

[6]  Xueqing Li,et al.  Leveraging stereopsis for saliency analysis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[8]  Alan Sullivan,et al.  DepthCube solid-state 3D volumetric display , 2004, IS&T/SPIE Electronic Imaging.

[9]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[10]  Wojciech Matusik,et al.  3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes , 2004, ACM Trans. Graph..

[11]  Markus Gross,et al.  Practical temporal consistency for image-based graphics applications , 2012, ACM Trans. Graph..

[12]  David M. Hoffman,et al.  The zone of comfort: Predicting visual discomfort with stereo displays. , 2011, Journal of vision.

[13]  Yannis Avrithis,et al.  Spatiotemporal saliency for video classification , 2009, Signal Process. Image Commun..

[14]  Alan Kingstone,et al.  Squeezing Uncertainty from Saccadic Compression , 2007 .

[15]  Alexander Toet,et al.  Visual comfort of binocular and 3D displays , 2004 .

[16]  F. Okano,et al.  Repeated vergence adaptation causes the decline of visual functions in watching stereoscopic television , 2005, Journal of Display Technology.

[17]  David Kane,et al.  The rate of change of vergence–accommodation conflict affects visual discomfort , 2014, Vision Research.

[18]  Gordon Wetzstein,et al.  Layered 3D: tomographic image synthesis for attenuation-based light field and high dynamic range displays , 2011, ACM Trans. Graph..

[19]  G. Lippmann,et al.  Epreuves reversibles. Photographies integrals , 1908 .

[20]  Qingshan Liu,et al.  Temporal spectral residual: fast motion saliency detection , 2009, ACM Multimedia.

[21]  B G Cumming,et al.  Disparity-induced and blur-induced convergence eye movement and accommodation in the monkey. , 1986, Journal of neurophysiology.

[22]  S. Jainta,et al.  Objective and subjective measures of vergence step responses , 2007, Vision Research.

[23]  Ramesh Raskar,et al.  NETRA: interactive display for estimating refractive errors and focal range , 2010, ACM Trans. Graph..

[24]  K N OGLE,et al.  Observations on accommodative convergence; especially its nonlinear relationships. , 1959, American journal of ophthalmology.

[25]  Ingo Fründ,et al.  Inference for psychometric functions in the presence of nonstationary behavior. , 2011, Journal of vision.

[26]  S. Pastoor,et al.  Stereoscopic image representation with synthetic depth of field , 1997 .

[27]  C. Schor,et al.  A dynamic model of cross-coupling between accommodation and convergence: simulations of step and frequency responses. , 1992, Optometry and vision science : official publication of the American Academy of Optometry.

[28]  Douglas Lanman,et al.  Near-eye light field displays , 2013, SIGGRAPH '13.

[29]  Hong Hua,et al.  Design and Assessment of a Depth-Fused Multi-Focal-Plane Display Prototype , 2014, Journal of Display Technology.

[30]  Martin S. Banks,et al.  A stereo display prototype with multiple focal distances , 2004, SIGGRAPH 2004.

[31]  Gordon Wetzstein,et al.  Layered 3D: tomographic image synthesis for attenuation-based light field and high dynamic range displays , 2011, SIGGRAPH 2011.

[32]  Joshua Napoli,et al.  100-million-voxel volumetric display , 2002, SPIE Defense + Commercial Sensing.

[33]  Bruce J W Evans,et al.  Monovision: a review , 2007, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[34]  J Semmlow,et al.  Dynamic contributions of the components of binocular vergence. , 1979, Journal of the Optical Society of America.

[35]  Fiora Pirri,et al.  Motion Saliency Maps from Spatiotemporal Filtering , 2009, WAPCV.

[36]  Gordon Wetzstein,et al.  Focus 3D: Compressive accommodation display , 2013, TOGS.

[37]  Gordon Wetzstein,et al.  Tensor displays , 2012, ACM Trans. Graph..

[38]  Ming C. Lin,et al.  Example-guided physically based modal sound synthesis , 2013, ACM Trans. Graph..

[39]  Donald H. House,et al.  Measuring gaze depth with an eye tracker during stereoscopic display , 2011, APGV '11.

[40]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[41]  Martin S. Banks,et al.  A stereo display prototype with multiple focal distances , 2004, ACM Trans. Graph..

[42]  Y. Takaki,et al.  Super multi-view display with a lower resolution flat-panel display. , 2011, Optics express.

[43]  Ching-Jen Chen,et al.  Numerical simulation of flow in a screw-type blood pump , 2005, J. Vis..

[44]  Hans-Peter Seidel,et al.  Real-time lens blur effects and focus control , 2010, SIGGRAPH 2010.

[45]  James F. O'Brien,et al.  Optimal presentation of imagery with focus cues on multi-plane displays , 2015, ACM Trans. Graph..

[46]  Nuno Vasconcelos,et al.  Spatiotemporal Saliency in Dynamic Scenes , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Philippe Fuchs,et al.  Real-time adaptive blur for reducing eye strain in stereoscopic displays , 2012, TAP.

[48]  E F FINCHAM,et al.  The reciprocal actions of accommodation and convergence , 1957, The Journal of physiology.

[49]  Kevin J. MacKenzie,et al.  Accommodation to multiple-focal-plane displays: Implications for improving stereoscopic displays and for accommodation control. , 2010, Journal of vision.

[50]  Hong Hua,et al.  An optical see-through multi-focal-plane stereoscopic display prototype enabling nearly correct focus cues , 2013, Electronic Imaging.

[51]  Yong Man Ro,et al.  Visual Importance- and Discomfort Region-Selective Low-Pass Filtering for Reducing Visual Discomfort in Stereoscopic Displays , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[52]  Stephanie Jainta,et al.  Comparison of shutter glasses and mirror stereoscope for measuring dynamic and static vergence , 2008 .

[53]  James Gao,et al.  High-speed switchable lens enables the development of a volumetric stereoscopic display. , 2009, Optics express.

[54]  Vitor F. Pamplona,et al.  NETRA: interactive display for estimating refractive errors and focal range , 2010 .

[55]  Manuela Chessa,et al.  Simulated disparity and peripheral blur interact during binocular fusion. , 2014, Journal of vision.

[56]  Robert S Allison,et al.  Stereoscopy and the Human Visual System. , 2011, SMPTE motion imaging journal.

[57]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[58]  R. Raskar,et al.  Content-adaptive parallax barriers: optimizing dual-layer 3D displays using low-rank light field factorization , 2010, SIGGRAPH 2010.

[59]  Derek Nowrouzezahrai,et al.  Learning hatching for pen-and-ink illustration of surfaces , 2012, TOGS.

[60]  Ken Perlin,et al.  An autostereoscopic display , 2000, SIGGRAPH.

[61]  Emily A. Cooper,et al.  Stereopsis is adaptive for the natural environment , 2015, Science Advances.

[62]  Nassir Navab,et al.  The effect of out-of-focus blur on visual discomfort when using stereo displays , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[63]  P Erickson,et al.  Patterns of Binocular Suppression and Accommodation in Monovision , 1988, American journal of optometry and physiological optics.

[64]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[65]  Yasuhiro Takaki,et al.  High-Density Directional Display for Generating Natural Three-Dimensional Images , 2006, Proceedings of the IEEE.

[66]  Martin S. Banks,et al.  Creating effective focus cues in multi-plane 3D displays , 2011, Optics express.