Retinal 3D

We introduce an augmented reality near-eye display dubbed "Retinal 3D." Key features of the proposed display system are as follows: Focus cues are provided by generating the pupil-tracked light field that can be directly projected onto the retina. Generated focus cues are valid over a large depth range since laser beams are shaped for a large depth of field (DOF). Pupil-tracked light field generation significantly reduces the needed information/computation load. Also, it provides "dynamic eye-box" which can be a break-through that overcome the drawbacks of retinal projection-type displays. For implementation, we utilized a holographic optical element (HOE) as an image combiner, which allowed high transparency with a thin structure. Compared with current augmented reality displays, the proposed system shows competitive performances of a large field of view (FOV), high transparency, high contrast, high resolution, as well as focus cues in a large depth range. Two prototypes are presented along with experimental results and assessments. Analysis on the DOF of light rays and validity of focus cue generation are presented as well. Combination of pupil tracking and advanced near-eye display technique opens new possibilities of the future augmented reality.

[1]  R A Abrams,et al.  Speed and accuracy of saccadic eye movements: characteristics of impulse variability in the oculomotor system. , 1989, Journal of experimental psychology. Human perception and performance.

[2]  Bahram Javidi,et al.  A 3D integral imaging optical see-through head-mounted display. , 2014, Optics express.

[3]  Philippe Fuchs,et al.  Real-time adaptive blur for reducing eye strain in stereoscopic displays , 2012, TAP.

[4]  Byoungho Lee,et al.  Recent progress in see-through three-dimensional displays using holographic optical elements [Invited]. , 2016, Applied optics.

[5]  Nassir Navab,et al.  The effect of out-of-focus blur on visual discomfort when using stereo displays , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[6]  Jae-Hyeung Park,et al.  3D holographic head mounted display using holographic optical elements with astigmatism aberration compensation. , 2015, Optics express.

[7]  Joachim Janes,et al.  High-Q MEMS Resonators for Laser Beam Scanning Displays , 2012, Micromachines.

[8]  Dieter Basler.  Holographic Optical Elements , 1989, Other Conferences.

[9]  G Westheimer,et al.  The Maxwellian view. , 1966, Vision research.

[10]  Gordon Wetzstein,et al.  Layered 3D: tomographic image synthesis for attenuation-based light field and high dynamic range displays , 2011, ACM Trans. Graph..

[11]  Martin S. Banks,et al.  Creating effective focus cues in multi-plane 3D displays , 2011, Optics express.

[12]  Ralph Michael,et al.  Neural contrast sensitivity calculated from measured total contrast sensitivity and modulation transfer function , 2010, Acta ophthalmologica.

[13]  Gordon Wetzstein,et al.  The light field stereoscope , 2015, ACM Trans. Graph..

[14]  Gordon Wetzstein,et al.  Layered 3D: tomographic image synthesis for attenuation-based light field and high dynamic range displays , 2011, SIGGRAPH 2011.

[15]  Demetri Psaltis,et al.  Holographic Data Storage , 1998, Computer.

[16]  Sheng Liu,et al.  A Novel Prototype for an Optical See-Through Head-Mounted Display with Addressable Focus Cues , 2010, IEEE Transactions on Visualization and Computer Graphics.

[17]  Sheng Liu,et al.  A systematic method for designing depth-fused multi-focal plane three-dimensional displays. , 2010, Optics express.

[18]  Nadine Gottschalk,et al.  Fundamentals Of Photonics , 2016 .

[19]  J. Kollin,et al.  A Retinal Display For Virtual-Environment Applications , 1993 .

[20]  James F. O'Brien,et al.  Optimal presentation of imagery with focus cues on multi-plane displays , 2015, ACM Trans. Graph..

[21]  Peter D. Burns,et al.  Slanted-Edge MTF for Digital Camera and Scanner Analysis , 2000, PICS.

[22]  Byoungho Lee,et al.  Additive light field displays , 2016, ACM Trans. Graph..

[23]  Thad Starner,et al.  A review of head-mounted displays (HMD) technologies and applications for consumer electronics , 2013, Defense, Security, and Sensing.

[24]  Byoungho Lee,et al.  Full-color lens-array holographic optical element for three-dimensional optical see-through augmented reality. , 2014, Optics letters.

[25]  Brian H. Marcus,et al.  Holographic data storage technology , 2000, IBM J. Res. Dev..

[26]  N.A. Polak,et al.  Dynamic interactions between accommodation and convergence , 1990, IEEE Transactions on Biomedical Engineering.

[27]  Philip B. Kruger,et al.  Spatiotemporal transfer function of human accommodation , 1994, Vision Research.

[28]  Gordon Wetzstein,et al.  Eyeglasses-free display , 2014, SIGGRAPH 2014.

[29]  Yasuhiro Takaki,et al.  Flat-panel see-through three-dimensional display based on integral imaging. , 2015, Optics letters.

[30]  Mitsuyoshi Watanabe,et al.  A retinal scanning display with a wavefront curvature modulator , 2003 .

[31]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[32]  Yasuhiro Takaki,et al.  Multi-projection of lenticular displays to construct a 256-view super multi-view display. , 2010, Optics express.

[33]  Andreas Georgiou,et al.  Holographic near-eye displays for virtual and augmented reality , 2017, ACM Trans. Graph..

[34]  Robert H Cormack,et al.  Wide-angle nonmechanical beam steering using liquid lenses. , 2016, Optics express.

[35]  P. Lukowicz,et al.  Defocusing simulations on a retinal scanning display for quasi accommodation-free viewing. , 2003, Optics express.

[36]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[37]  Thomas A. Furness,et al.  A retinal scanning display system that produces multiple focal planes with a deformable membrane mirror , 2003 .

[38]  Ken Yuh Hsu,et al.  Grating detuning effect on holographic memory in photopolymers , 2001 .

[39]  Yong-Moo Kwon,et al.  Analysis of a head-mounted display-type multifocus display system using a laser scanning method , 2011 .