Near-eye light field displays

We propose a light-field-based approach to near-eye display that allows for thin, lightweight head-mounted displays capable of depicting accurate accommodation, convergence, and binocular disparity depth cues. Our near-eye light field displays depict sharp images from out-of-focus display elements by synthesizing light fields corresponding to virtual scenes located within the viewer's natural accommodation range. While sharing similarities with existing integral imaging displays and microlens-based light field cameras, we optimize performance in the context of near-eye viewing. Near-eye light field displays support continuous accommodation of the eye throughout a finite depth of field; as a result, binocular configurations provide a means to address the accommodation-convergence conflict occurring with existing stereoscopic displays. We construct a binocular prototype and a GPU-accelerated stereoscopic light field renderer.

[1]  Ricardo Martins,et al.  Compact microlenslet-array-based magnifier. , 2004, Optics letters.

[2]  R. Anderson.  Close-up imaging of documents and displays with lens arrays. , 1979, Applied optics.

[3]  Frédo Durand,et al.  Antialiasing for automultiscopic 3D displays , 2006, EGSR '06.

[4]  Hironobu Gotoda.  A multilayer liquid crystal display for autostereoscopic 3D viewing , 2010, Electronic Imaging.

[5]  Wojciech Matusik,et al.  Computing and fabricating multilayer models , 2011, ACM Trans. Graph..

[6]  Hong Hua,et al.  Head-Mounted Display Systems , 2005 .

[7]  Martin S. Banks,et al.  A stereo display prototype with multiple focal distances , 2004, SIGGRAPH 2004.

[8]  Yasuhiro Takaki,et al.  High-Density Directional Display for Generating Natural Three-Dimensional Images , 2006, Proceedings of the IEEE.

[9]  Hakan Urey,et al.  Microlens-array-based exit-pupil expander for full-color displays. , 2005, Applied optics.

[10]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[11]  Joohwan Kim,et al.  Point light source integral imaging with improved resolution and viewing angle by the use of electrically movable pinhole array. , 2007, Optics express.

[12]  Gordon Wetzstein,et al.  Tensor displays , 2012, ACM Trans. Graph..

[13]  Alexei A. Goon,et al.  Multifocal planes head-mounted displays. , 2000, Applied optics.

[14]  B. Javidi,et al.  Effects of device resolution on three-dimensional integral imaging. , 2004, Optics letters.

[15]  Ken Perlin,et al.  An autostereoscopic display , 2000, SIGGRAPH.

[16]  M. Hutley,et al.  The moire magnifier , 1994 .

[17]  P. Anderson,et al.  Through the Glass Lightly , 1995, Science.

[18]  Joachim Bunkenburg,et al.  Innovative diffractive eyepiece for a helmet-mounted display , 1998, Optics & Photonics.

[19]  Jaakko Lehtinen,et al.  Temporal light field reconstruction for rendering distribution effects Citation , 2011 .

[20]  James Gao,et al.  High-speed switchable lens enables the development of a volumetric stereoscopic display. , 2009, Optics express.

[21]  Thad Starner,et al.  A review of head-mounted displays (HMD) technologies and applications for consumer electronics , 2013, Defense, Security, and Sensing.

[22]  Robert W. Massof,et al.  37.1: Invited Paper: Full-Field High-Resolution Binocular HMD , 2003 .

[23]  Mark T. Bolas,et al.  A design for a smartphone-based head mounted display , 2011, 2011 IEEE Virtual Reality Conference.

[24]  G. Lippmann.  Epreuves reversibles donnant la sensation du relief , 1908 .

[25]  David M. Hoffman,et al.  The zone of comfort: Predicting visual discomfort with stereo displays. , 2011, Journal of vision.

[26]  S. Mann.  Through the Glass, Lightly [Viewpoint] , 2012, IEEE Technol. Soc. Mag..

[27]  Ramesh Raskar,et al.  NETRA: interactive display for estimating refractive errors and focal range , 2010, ACM Trans. Graph..

[28]  Andreas Dietrich,et al.  OptiX: a general purpose ray tracing engine , 2010, SIGGRAPH 2010.

[29]  Markus H. Gross,et al.  The magic lens , 2012, ACM Trans. Graph..

[30]  Emily A. Cooper,et al.  Blur and Disparity Are Complementary Cues to Depth , 2012, Current Biology.

[31]  Matthias Wöpking,et al.  3-D displays: A review of current technologies , 1997 .

[32]  Philip C. D. Hobbs,et al.  Building Electro-Optical Systems: Making It all Work , 2009 .

[33]  Daniel G. Aliaga,et al.  Tailored displays to compensate for visual aberrations , 2012, ACM Trans. Graph..

[34]  Sheng Liu,et al.  A Novel Prototype for an Optical See-Through Head-Mounted Display with Addressable Focus Cues , 2010, IEEE Transactions on Visualization and Computer Graphics.

[35]  M. Levoy,et al.  Recording and controlling the 4D light field in a microscope using microlens arrays , 2009, Journal of microscopy.

[36]  Neil A. Dodgson.  Analysis of the viewing zone of multiview autostereoscopic displays , 2002, IS&T/SPIE Electronic Imaging.

[37]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .