Beaming Displays

Existing near-eye display designs struggle to balance between multiple trade-offs such as form factor, weight, computational requirements, and battery life. These design trade-offs are major obstacles on the path towards an all-day usable near-eye display. In this work, we address these trade-offs by, paradoxically, removing the display from near-eye displays. We present the beaming displays, a new type of near-eye display system that uses a projector and an all passive wearable headset. We modify an off-the-shelf projector with additional lenses. We install such a projector to the environment to beam images from a distance to a passive wearable headset. The beaming projection system tracks the current position of a wearable headset to project distortion-free images with correct perspectives. In our system, a wearable headset guides the beamed images to a user's retina, which are then perceived as an augmented scene within a user's field of view. In addition to providing the system design of the beaming display, we provide a physical prototype and show that the beaming display can provide resolutions as high as consumer-level near-eye displays. We also discuss the different aspects of the design space for our proposal.

[1]  Henry Fuchs,et al.  Manufacturing Application-Driven Foveated Near-Eye Displays , 2019, IEEE Transactions on Visualization and Computer Graphics.

[2]  Hrvoje Benko,et al.  Dyadic projected spatial augmented reality , 2014, UIST.

[3]  Mehmet Göktürk,et al.  Involuntary postural responses of users as input to Attentive Computing Systems: An investigation on head movements , 2012, Comput. Hum. Behav..

[4]  Jannick P Rolland,et al.  Starting geometry creation and design method for freeform optics , 2018, Nature Communications.

[5]  Yuta Itoh,et al.  Varifocal Occlusion for Optical See-Through Head-Mounted Displays using a Slide Occlusion Mask , 2019, IEEE Transactions on Visualization and Computer Graphics.

[6]  Hakan Urey,et al.  Microlens array-based high-gain screen design for direct projection head-up displays. , 2013, Applied optics.

[7]  Fabrício Herpich,et al.  A Comparative Analysis of Augmented Reality Frameworks Aimed at the Development of Educational Applications , 2017 .

[8]  Zhaocheng Liu,et al.  Metasurfaces for near-eye augmented reality , 2019, ACS Photonics.

[9]  Masatoshi Ishikawa,et al.  VarioLight: hybrid dynamic projection mapping using high-speed projector and optical axis controller , 2018, SIGGRAPH ASIA Emerging Technologies.

[10]  Kaan Akşit,et al.  Patch scanning displays: spatiotemporal enhancement for displays. , 2020, Optics express.

[11]  Masatoshi Ishikawa,et al.  Dynamic Projection Mapping onto Deforming Non-Rigid Surface Using Deformable Dot Cluster Marker , 2017, IEEE Transactions on Visualization and Computer Graphics.

[12]  Yuta Itoh,et al.  StainedView: Variable-Intensity Light-Attenuation Display with Cascaded Spatial Color Filtering for Improved Color Fidelity , 2020, IEEE Transactions on Visualization and Computer Graphics.

[13]  Masatoshi Ishikawa,et al.  High-Speed Focal Tracking Projection Based on Liquid Lens , 2020, SIGGRAPH Emerging Technologies.

[14]  Yoji Ito,et al.  16‐3: A Novel Transparent Screen Using Cholesteric Liquid Crystal Dots , 2016 .

[15]  Daniel Kade,et al.  Head-mounted mixed reality projection display for games production and entertainment , 2015, Personal and Ubiquitous Computing.

[16]  Katashi Nagao,et al.  The world through the computer: computer augmented interaction with real world environments , 1995, UIST '95.

[17]  B. G. DeLacy,et al.  Transparent displays enabled by resonant nanoparticle scattering , 2014, Nature Communications.

[18]  Bernard C. Kress,et al.  Optical waveguide combiners for AR headsets: features and limitations , 2019, Other Conferences.

[19]  Kosuke Sato,et al.  Dynamic Path Planning of Flying Projector Considering Collision Avoidance with Observer and Bright Projection , 2018, IUI Companion.

[20]  Kosuke Sato,et al.  Extended Depth-of-Field Projector by Fast Focal Sweep Projection , 2015, IEEE Transactions on Visualization and Computer Graphics.

[21]  Paul S. Martin Mojo vision nanoLEDs for invisible computing , 2020, OPTO.

[22]  Jannick P. Rolland,et al.  See-Through Head Worn Display (HWD) Architectures , 2012, Handbook of Visual Display Technology.

[23]  Andrew J. Woods 3-D displays in the home , 2009 .

[24]  Zhen Wang,et al.  Draining our glass: an energy and heat characterization of Google Glass , 2014, APSys.

[25]  LUDWIG SIDENMARK,et al.  Eye, Head and Torso Coordination During Gaze Shifts in Virtual Reality , 2019, ACM Trans. Comput. Hum. Interact..

[26]  Aykut Avci,et al.  Progress toward a liquid crystal contact lens display , 2013 .

[27]  Shoaib R. Soomro,et al.  Design, fabrication and characterization of transparent retro-reflective screen. , 2016, Optics express.

[28]  Eyal Ofek,et al.  FoveAR: Combining an Optically See-Through Near-Eye Display with Projector-Based Spatial Augmented Reality , 2015, UIST.

[29]  Laura Waller,et al.  High resolution étendue expansion for holographic displays , 2020, ACM Trans. Graph..

[30]  Masatoshi Ishikawa,et al.  Lumipen: Projection-Based Mixed Reality for Dynamic Objects , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[31]  Peter D. Burns,et al.  Slanted-Edge MTF for Digital Camera and Scanner Analysis , 2000, PICS.

[32]  Masatoshi Ishikawa,et al.  High-speed image rotator for blur-canceling roll camera , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[33]  Anselmo Lastra,et al.  From Motion to Photons in 80 Microseconds: Towards Minimal Latency for Virtual and Augmented Reality , 2016, IEEE Transactions on Visualization and Computer Graphics.

[34]  P. Török,et al.  Computational methods in vectorial imaging , 2011 .

[35]  Ramesh Raskar,et al.  Bokode: imperceptible visual tags for camera based interaction from a distance , 2009, ACM Trans. Graph..

[36]  Ramesh Raskar,et al.  Modern approaches to augmented reality , 2005, SIGGRAPH Courses.

[37]  Holger Regenbrecht,et al.  ChromaGlasses: Computational Glasses for Compensating Colour Blindness , 2018, CHI.

[38]  Katerina Mania,et al.  Near‐Eye Display and Tracking Technologies for Virtual and Augmented Reality , 2019, Comput. Graph. Forum.

[39]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.