Creating the Perfect Illusion: What will it take to Create Life-Like Virtual Reality Headsets?

As Virtual Reality (VR) Head Mounted Displays (HMD) push the boundaries of technology, in this paper, we try and answer the question, "What would it take to make the visual experience of a VR-HMD Life-Like, i.e., indistinguishable from physical reality?" Based on the limits of human perception, we first try and establish the specifications for a Life-Like HMD. We then examine crucial technological trends and speculate on the feasibility of Life-Like VR headsets in the near future. Our study indicates that while display technology will be capable of Life-Like VR, rendering computation is likely to be the key bottleneck. Life-Like VR solutions will likely involve frames rendered on a separate machine and then transmitted to the HMD. Can we transmit Life-Like VR frames wirelessly to the HMD and make the HMD cable-free? We find that current wireless and compression technology may not be sufficient to accommodate the bandwidth and latency requirements. We outline research directions towards achieving Life-Like VR.

[1]  Sigurd Ry Andersen,et al.  The history of the Ophthalmological Society of Copenhagen 1900-50. , 2002, Acta ophthalmologica Scandinavica. Supplement.

[2]  Xiang-Yang Li,et al.  Diamond: Nesting the Data Center Network With Wireless Rings in 3-D Space , 2016, IEEE/ACM Transactions on Networking.

[3]  S. Klein,et al.  Resolution Acuity is better than Vernier Acuity , 1997, Vision Research.

[4]  David Fitzpatrick,et al.  Types of Eye Movements and Their Functions , 2001 .

[5]  E. Bober,et al.  Development of the Vertebrate Inner Ear , 2001, Annals of the New York Academy of Sciences.

[6]  Christopher J. Hansen,et al.  WiGiG: Multi-gigabit wireless communications in the 60 GHz band , 2011, IEEE Wireless Communications.

[7]  I. Rentschler,et al.  Peripheral vision and pattern recognition: a review. , 2011, Journal of vision.

[8]  Alec Wolman,et al.  MAUI: making smartphones last longer with code offload , 2010, MobiSys '10.

[9]  David Chu,et al.  Poster: Mobile Virtual Reality for Head-mounted Displays With Interactive Streaming Video and Likelihood-based Foveation , 2016, MobiSys '16 Companion.

[10]  B. Cohen,et al.  The Human Vestibulo‐Ocular Reflex during Linear Locomotion , 2001, Annals of the New York Academy of Sciences.

[11]  Eduardo Cuervo BEYOND REALITY: Head-Mounted Displays for Mobile Systems Researchers , 2017, GETMBL.

[12]  Alec Wolman,et al.  Demo: Kahawai: high-quality mobile gaming using GPU offload , 2015, MobiSys.

[13]  Desney S. Tan,et al.  Foveated 3D graphics , 2012, ACM Trans. Graph..

[14]  Tania Pouli,et al.  Evaluation of color encodings for high dynamic range pixels , 2015, Electronic Imaging.

[15]  D. Purves,et al.  Neuroscience. 2nd edition , 2001 .

[16]  Steven M. LaValle,et al.  Head tracking for the Oculus Rift , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Frederick Walls,et al.  VESA Display Stream Compression for Television and Cinema Applications , 2016, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[18]  J-P Raskin SOI substrates for More than Moore roadmap , 2012, 2012 8th International Caribbean Conference on Devices, Circuits and Systems (ICCDCS).

[19]  Kai Zheng,et al.  FSONet: A Wireless Backhaul for Multi-Gigabit Picocells Using Steerable Free Space Optics , 2017, MobiCom.

[20]  Shunpei Yamazaki,et al.  Ultra‐high‐resolution 1058‐ppi OLED displays with 2.78‐in size using CAAC‐IGZO FETs with tandem OLED device and single OLED device , 2016 .

[21]  Himanshu Shah,et al.  FireFly , 2014, SIGCOMM.

[22]  Joohwan Kim,et al.  Towards foveated rendering for gaze-tracked virtual reality , 2016, ACM Trans. Graph..

[23]  David Chu,et al.  FlashBack: Immersive Virtual Reality on Mobile Devices via Rendering Memoization , 2016, MobiSys.

[24]  Hans-Peter Seidel,et al.  Proxy‐guided Image‐based Rendering for Mobile Devices , 2016, Comput. Graph. Forum.

[25]  Leonard McMillan,et al.  Post-rendering 3D warping , 1997, SI3D.