Wide Field Of View Varifocal Near-Eye Display Using See-Through Deformable Membrane Mirrors

Accommodative depth cues, a wide field of view, and ever-higher resolutions all present major hardware design challenges for near-eye displays. Optimizing a design to overcome one of these challenges typically leads to a trade-off in the others. We tackle this problem by introducing an all-in-one solution — a new wide field of view, gaze-tracked near-eye display for augmented reality applications. The key component of our solution is the use of a single see-through, varifocal deformable membrane mirror for each eye reflecting a display. They are controlled by airtight cavities and change the effective focal power to present a virtual image at a target depth plane which is determined by the gaze tracker. The benefits of using the membranes include wide field of view (100° diagonal) and fast depth switching (from 20 cm to infinity within 300 ms). Our subjective experiment verifies the prototype and demonstrates its potential benefits for near-eye see-through displays.

[1]  Bin Wang,et al.  Depth-of-focus of the human eye: theory and clinical implications. , 2006, Survey of ophthalmology.

[2]  Yasushi Yagi,et al.  Super Wide Field of View Head Mounted Display Using Catadioptrical Optics , 2006, PRESENCE: Teleoperators and Virtual Environments.

[3]  Kiyoshi Kiyokawa.  A Wide Field-of-view Head Mounted Projective Display using Hyperbolic Half-silvered Mirrors , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[4]  Clifton M. Schor,et al.  Acceleration characteristics of human ocular accommodation , 2005, Vision Research.

[5]  M. C. Costa,et al.  Augmented reality technologies to promote STEM learning , 2018, 2018 13th Iberian Conference on Information Systems and Technologies (CISTI).

[6]  BY F. W. CAMIPBELL,et al.  DYNAMICS OF ACCOMMODATION RESPONSES OF THE HUMAN EYE , 2006 .

[7]  John R. Rogers,et al.  Design of an advanced helmet mounted display (AHMD) , 2005, SPIE Defense + Commercial Sensing.

[8]  Ernesto Damiani,et al.  Augmented reality technologies, systems and applications , 2010, Multimedia Tools and Applications.

[9]  Desney S. Tan,et al.  Foveated 3D graphics , 2012, ACM Trans. Graph..

[10]  Bin Wang,et al.  Depth-of-focus of the human eye in the near retinal periphery , 2003, Vision Research.

[11]  Neil A. Dodgson,et al.  Variation and extrema of human interpupillary distance , 2004, IS&T/SPIE Electronic Imaging.

[12]  Eric G. Rawson,et al.  Vibrating varifocal mirrors for 3-D imaging , 1969 .

[13]  Gordon Wetzstein,et al.  Novel Optical Configurations for Virtual Reality: Evaluating User Preference and Performance with Focus-tunable and Monovision Near-eye Displays , 2016, CHI.

[14]  Sung-Keun Lee,et al.  Three-dimensional holographic head mounted display using holographic optical element , 2015, 2015 IEEE International Conference on Consumer Electronics (ICCE).

[15]  Douglas Lanman,et al.  Near-eye light field displays , 2013, SIGGRAPH Emerging Technologies.

[16]  Douglas Lanman,et al.  Pinlight displays , 2014, ACM Trans. Graph..

[17]  Robert L. Byer,et al.  Deformable mirror development at Stanford University , 2002, Optics + Photonics.

[18]  Giuseppe Molesini,et al.  Depth of Focus in Peripheral Vision , 1975 .

[19]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[20]  A. Werber,et al.  Tunable Pneumatic Microoptics , 2008, Journal of Microelectromechanical Systems.

[21]  G. Lippmann,et al.  Epreuves reversibles. Photographies integrals , 1908 .

[22]  Mei-Lan Piao,et al.  Holographic Head Mounted Display using Holographic Optical Element. , 2015 .

[23]  Gordon H. Spencer,et al.  General ray-tracing procedure , 1962 .

[24]  Steven Mason,et al.  Membrane-mirror-based autostereoscopic display for tele-operation and teleprescence applications , 2000, Electronic Imaging.

[25]  Christopher D. Saunter,et al.  Assessing visual discomfort using dynamic lens and monovision displays , 2016 .

[26]  Jan Kautz,et al.  Slim near-eye display using pinhole aperture arrays. , 2015, Applied optics.

[27]  C. Schor,et al.  Dynamics of the accommodation response to abrupt changes in target vergence as a function of age , 2001, Vision Research.

[28]  Gordon Wetzstein,et al.  The light field stereoscope , 2015, SIGGRAPH Emerging Technologies.

[29]  Adrian Glasser,et al.  Amplitude dependent accommodative dynamics in humans , 2003, Vision Research.

[30]  Hong Hua,et al.  Effects of Optical Combiner and IPD Change for Convergence on Near-Field Depth Perception in an Optical See-Through HMD , 2016, IEEE Transactions on Visualization and Computer Graphics.

[31]  J. C. Kotulak,et al.  The Accommodative Response to Subthreshold Blur and to Perceptual Fading during the Troxler Phenomenon , 1986, Perception.

[32]  Campbell Fw.  A method for measuring the depth of field of the human eye. , 1954 .

[33]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[34]  Eyal Ofek,et al.  FoveAR: Combining an Optically See-Through Near-Eye Display with Projector-Based Spatial Augmented Reality , 2015, UIST.

[35]  S Phillips,et al.  ANALYSIS OF ACCOMMODATIVE RESPONSE TIMES USING HISTOGRAM INFORMATION* , 1972, American journal of optometry and archives of American Academy of Optometry.

[36]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[37]  Takeo Kanade,et al.  Simultaneous self-calibration of a projector and a camera using structured light , 2011, CVPR 2011 WORKSHOPS.

[38]  Steve Arscott,et al.  Extended PDMS stiffness range for flexible systems , 2015 .

[39]  Sheng Liu,et al.  An optical see-through head mounted display with addressable focal planes , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[40]  Mark Billinghurst,et al.  An occlusion capable optical see-through head mount display for supporting co-located collaboration , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[41]  Christopher D. Saunter,et al.  Dynamic lens and monovision 3D displays to improve viewer comfort , 2015, Optics express.

[42]  Bahram Javidi,et al.  A 3D integral imaging optical see-through head-mounted display. , 2014, Optics express.

[43]  Leslie S. Mair,et al.  Membrane-mirror-based display for viewing 2D and 3D images , 1999, Electronic Imaging.

[44]  Gregory Kramida,et al.  Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays , 2016, IEEE Transactions on Visualization and Computer Graphics.

[45]  Hong Hua,et al.  High-resolution optical see-through multi-focal-plane head-mounted display using freeform optics. , 2014, Optics express.