Virtual and Augmented Reality on the 5G Highway

In recent years, virtual and augmented reality have begun to take advantage of the high speed capabilities of data streaming technologies and wireless networks. However, limitations like bandwidth and latency still prevent us from achieving high fidelity telepresence and collaborative virtual and augmented reality applications. Fortunately, both researchers and engineers are aware of these problems and have set out to design 5G networks to help us to move to the next generation of virtual interfaces. This paper reviews state of the art virtual and augmented reality communications technology and outlines current efforts to design an effective, ubiquitous 5G network to help to adapt to virtual application demands. We discuss application needs in domains like telepresence, education, healthcare, streaming media, and haptics, and provide guidelines and future directions for growth based on this new network infrastructure.

[1]  Rod Furlan.  The future of augmented reality: Hololens - Microsoft's AR headset shines despite rough edges [Resources_Tools and Toys] , 2016, IEEE Spectrum.

[2]  Jan Peters,et al.  First-person tele-operation of a humanoid robot , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[3]  Mark Billinghurst,et al.  Out and About — Real World Teleconferencing , 2000 .

[4]  Mark Billinghurst,et al.  Shared space: An augmented reality approach for computer supported collaborative work , 1998, Virtual Reality.

[5]  Tuukka M. Takala,et al.  Full body interaction in virtual reality with affordable hardware , 2014, 2014 IEEE Virtual Reality (VR).

[6]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[7]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[8]  Soh-Khim Ong,et al.  Virtual and Augmented Reality Applications in Manufacturing , 2004, MIM.

[9]  Anoop Gupta,et al.  Communication behaviors of co-located users in collaborative AR interfaces , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[10]  Daniel Freedman,et al.  Reality Skins: Creating Immersive and Tactile Virtual Environments , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[11]  Stephen A. Brewster,et al.  Investigating the effectiveness of tactile feedback for mobile touchscreens , 2008, CHI.

[12]  Andrzej A. Kononowicz,et al.  Beyond xMOOCs in healthcare education: study of the feasibility in integrating virtual patient systems and MOOC platforms , 2014, PeerJ.

[13]  Steve Benford,et al.  MASSIVE: a collaborative virtual environment for teleconferencing , 1995, TCHI.

[14]  Ilana Nisky,et al.  HapSticks: A novel method to present vertical forces in tool-mediated interactions by a non-grounded rotation mechanism , 2015, 2015 IEEE World Haptics Conference (WHC).

[15]  Vili Lehdonvirta,et al.  Game Design as Marketing: How Game Mechanics Create Demand for Virtual Goods , 2010 .

[16]  Pushmeet Kohli,et al.  Fusion4D , 2016, ACM Trans. Graph..

[17]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[18]  Muhammad Mostafa Monowar,et al.  Rise of Augmented Reality: Current and Future Application Areas , 2013 .

[19]  Antonija Mitrovic,et al.  Intelligent Augmented Reality Training for Motherboard Assembly , 2015, International Journal of Artificial Intelligence in Education.

[20]  Nancy Proctor,et al.  The Google Art Project: A New Generation of Museums on the Web? , 2011 .

[21]  Kai Kunze,et al.  Eyewear Computing - Augmenting the Human with Head-mounted Wearable Assistants (Dagstuhl Seminar 16042) , 2016, Dagstuhl Reports.

[22]  Fernando Trinta,et al.  A real-time x-ray mobile application using augmented reality and google street view , 2016, VRST.

[23]  Gudrun Klinker,et al.  Vision enhancement: defocus correction via optical see-through head-mounted displays , 2015, AH.

[24]  Mehdi Mekni,et al.  Augmented Reality : Applications , Challenges and Future Trends , 2014 .

[25]  Charles T. Loop,et al.  Holoportation: Virtual 3D Teleportation in Real-time , 2016, UIST.

[26]  Didier Stricker,et al.  Real-time modeling and tracking manual workflows from first-person vision , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[27]  Dieter Schmalstieg,et al.  The Studierstube Augmented Reality Project , 2002, Presence: Teleoperators & Virtual Environments.

[28]  Anoop Gupta,et al.  How low should we go?: understanding the perception of latency while inking , 2014, Graphics Interface.

[29]  Hiroshi Ishii,et al.  Physical telepresence: shape capture and display for embodied, computer-mediated remote collaboration , 2014, UIST.

[30]  Uno Fors,et al.  Immersive Networking-A Framework for Virtual Environments with Augmented Reality in Human Decision-Making , 2016, MUE 2016.

[31]  Fumio Kishino,et al.  Augmented reality: a class of displays on the reality-virtuality continuum , 1995, Other Conferences.

[32]  Gudrun Klinker,et al.  Laplacian Vision: Augmenting Motion Prediction via Optical See-Through Head-Mounted Displays , 2016, AH.

[33]  Michael Zyda,et al.  A real-time, three-dimensional moving platform visualization tool , 1990, Comput. Graph..

[34]  Joseph J. LaViola,et al.  CavePainting: a fully immersive 3D artistic medium and interactive experience , 2001, I3D '01.

[35]  Bruce H. Thomas,et al.  ARQuake: an outdoor/indoor augmented reality first person application , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[36]  Richard Taylor,et al.  The SIMNET Network and Protocol , 1987 .

[37]  Daniel Sonntag,et al.  ModulAR: Eye-Controlled Vision Augmentations for Head Mounted Displays , 2015, IEEE Transactions on Visualization and Computer Graphics.

[38]  Alain Bernard,et al.  CAD model based virtual assembly simulation, planning and training , 2013 .

[39]  Peter E.D. Love,et al.  Augmented Reality in built environment: Classification and implications for future research , 2013 .

[40]  Xiang Cao,et al.  Beyond stereo: an exploration of unconventional binocular presentation for novel visual experience , 2012, CHI.

[41]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[42]  Andrew J. Davison,et al.  DTAM: Dense tracking and mapping in real-time , 2011, 2011 International Conference on Computer Vision.

[43]  Maria Rita Palattella,et al.  Internet of Things in the 5G Era: Enablers, Architecture, and Business Models , 2016, IEEE Journal on Selected Areas in Communications.

[44]  Tobias Höllerer,et al.  Improved outdoor augmented reality through "Globalization" , 2013, ISMAR.

[45]  Naokazu Yokoya,et al.  SeamlessDesign for 3D Object Creation , 2000, IEEE Multim..

[46]  David J. Brady,et al.  Multiscale gigapixel photography , 2012, Nature.

[47]  Christer Carlsson,et al.  DIVE A multi-user virtual reality system , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[48]  Poonsri Vate-U-Lan.  Envisioning augmented reality: smart technology for the future , 2012 .