State of the art of virtual reality technology

In the past three years, the so-called second wave of Virtual Reality (VR) has brought us a vast amount of new displays and input devices. Not only new hardware has entered the consumer market providing affordable pricing models but also completely new technologies are being designed and developed. Additionally new concepts for handling existing problems on the hardware and software side of the VR technology are constantly being introduced. This software and hardware development is mainly lead by enthusiasts interested in the domain of VR opposed to the established scientific community, which already partially makes use of the newly available technology. Besides Head-Mounted Displays (HMDs), either cable-based or mobile, other devices like haptics devices, controllers, vests, omnidirectional treadmills, tracking technologies, as well as optical scanners for gesture-based interaction are gaining importance in the field of commodity VR. Most of these technologies are already precise and robust enough to be used for professional operation and scientific experiments. The topics discussed are the common issues with the new technologies including the approaches to solve them as for example motion-to-photon latency, barrel distortion, and low-persistence displays. Additionally an in-depth analysis of the available solutions expected to hit the market is provided. A taxonomy categorising the current developments with the chosen implementation approaches will be given. The paper analyses the state of technological advancements in the field and provides an extensive overview on the current development considering the upcoming devices and the advancements from the software side.

[1]  Thomas Bangert,et al.  Colour: an algorithmic approach , 2012 .

[2]  Muhanna Muhanna,et al.  Virtual reality and the CAVE: Taxonomy, interaction challenges and research directions , 2015, J. King Saud Univ. Comput. Inf. Sci..

[3]  William R. Provancher,et al.  Discrimination thresholds for communicating rotational inertia and torque using differential skin stretch feedback in virtual environments , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[4]  Jonathan Linowes,et al.  Unity Virtual Reality Projects , 2015 .

[5]  Michael Zyda,et al.  Networked virtual environments - desgin and implementation , 1999 .

[6]  Lijun Xie,et al.  An efficient projection defocus algorithm based on multi-scale convolution kernel templates , 2013, Journal of Zhejiang University SCIENCE C.

[7]  Dieter Schmalstieg,et al.  Strolling Through Cyberspace With Your Hands In Your Pockets: Head Directed Navigation In Virtual Environments , 1998, EGVE.

[8]  Takao Yamaguchi,et al.  The effect of the configuration and the interior design of a virtual weightless space station on human spatial orientation. , 2005, Acta astronautica.

[9]  Michael Zyda,et al.  A Taxonomy for Networked Virtual Environments , 1997, IEEE Multim..

[10]  Warren Robinett,et al.  Virtual environment display system , 1987, I3D '86.

[11]  Michael E. McCauley,et al.  Cybersickness: Perception of Self-Motion in Virtual Environments , 1992, Presence: Teleoperators & Virtual Environments.

[12]  Dieter Kranzlmüller,et al.  ShoeSoleSense: proof of concept for a wearable foot interface for virtual and real environments , 2013, VRST '13.

[13]  Klaus H. Hinrichs,et al.  Enhancing Presence in Head-Mounted Display Environments by Visual Body Feedback Using Head-Mounted Cameras , 2009, 2009 International Conference on CyberWorlds.

[14]  Doug A. Bowman,et al.  A methodology for the evaluation of travel techniques for immersive virtual environments , 1998, Virtual Reality.

[15]  Doug A. Bowman,et al.  Novel Uses of Pinch Gloves™ for Virtual Environment Interaction Techniques , 2002, Virtual Reality.

[16]  Ivan E. Sutherland,et al.  The Ultimate Display , 1965 .

[17]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[18]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[19]  F. Raab,et al.  Magnetic Position and Orientation Tracking System , 1979, IEEE Transactions on Aerospace and Electronic Systems.

[20]  Marc M. Sebrechts,et al.  HANDBOOK OF VIRTUAL ENVIRONMENTS , 2014 .

[21]  Mark R. Mine,et al.  Virtual Environment Interaction Techniques , 1995 .

[22]  Steven M. LaValle,et al.  Head tracking for the Oculus Rift , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Tony Parisi,et al.  Learning Virtual Reality: Developing Immersive Experiences and Applications for Desktop, Web, and Mobile , 2015 .

[24]  Masaaki Kumagai.  Development of a ball drive unit using partially sliding rollers — An alternative mechanism for semi-omnidirectional motion — , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Hiroo Iwata,et al.  Walking about virtual environments on an infinite floor , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[26]  Stephan Diehl.  Distributed virtual worlds - foundations and implementation techniques using VRML, Java, and CORBA , 2001 .

[27]  Jens Volkert,et al.  inVRs - A Framework for Building Interactive Networked Virtual Reality Systems , 2006, HPCC.

[28]  Mel Slater,et al.  The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment , 2003, CHI '03.

[29]  Anand K. Gramopadhye,et al.  Binocular eye tracking in virtual reality for inspection training , 2000, ETRA.

[30]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[31]  Robert W. Lindeman,et al.  Towards full-body haptic feedback: the design and deployment of a spatialized vibrotactile feedback system , 2004, VRST '04.

[32]  Henry Fuchs,et al.  Comparison of optical and video see-through, head-mounted displays , 1995, Other Conferences.

[33]  Anthony Steed,et al.  Networked Graphics - Building Networked Games and Virtual Environments , 2009 .

[34]  Ning-Ning Zhou,et al.  Virtual reality: A state-of-the-art survey , 2009, Int. J. Autom. Comput..

[35]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[36]  Gordon Wetzstein,et al.  The light field stereoscope , 2015, ACM Trans. Graph..

[37]  Doug A. Bowman,et al.  Formalizing the Design, Evaluation, and Application of Interaction Techniques for Immersive Virtual Environments , 1999, J. Vis. Lang. Comput..

[38]  Katerina Mania,et al.  A Classification for User Embodiment in Collaborative Virtual Environments , 1998 .

[39]  Robert J. Stone,et al.  Evolution of aerospace simulation: From immersive Virtual Reality to serious games , 2011, Proceedings of 5th International Conference on Recent Advances in Space Technologies - RAST2011.

[40]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[41]  Joseph J. LaViola,et al.  A discussion of cybersickness in virtual environments , 2000, SGCH.

[42]  Daniel Thalmann,et al.  A Taxonomy of Networked Virtual Environments , 1999 .

[43]  Kay M. Stanney,et al.  Handbook of Virtual Environments - Design, Implementation, and Applications, Second Edition , 2014, Handbook of Virtual Environments, 2nd ed..

[44]  Henrik Tramberend,et al.  Avocado: a distributed virtual reality framework , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[45]  Gerard Jounghyun Kim,et al.  Design and evaluation of a wind display for virtual reality , 2004, VRST '04.

[46]  Hiroshi Ishida,et al.  Multi-sensorial field display: Presenting spatial distribution of airflow and odor , 2011, 2011 IEEE Virtual Reality Conference.

[47]  Haruo Noma,et al.  SpotScents: A Novel Method of Natural Scent Delivery Using Multiple Scent Projectors , 2006, IEEE Virtual Reality Conference (VR 2006).

[48]  Joseph L. Gabbard.  A Taxonomy of Usability Characteristics in Virtual Environments , 1997 .

[49]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[50]  Carolina Cruz-Neira,et al.  VR Juggler: a virtual platform for virtual reality application development , 2001, Proceedings IEEE Virtual Reality 2001.

[51]  Salvatore Livatino,et al.  Handbook for Evaluation Studies in Virtual Reality , 2007, 2007 IEEE Symposium on Virtual Environments, Human-Computer Interfaces and Measurement Systems.

[52]  Greg Welch,et al.  Motion Tracking: No Silver Bullet, but a Respectable Arsenal , 2002, IEEE Computer Graphics and Applications.

[53]  Randy F. Pausch,et al.  Virtual reality on five dollars a day , 1991, CHI.

[54]  Kristopher J. Blom,et al.  A New Gaming Device and Interaction Method for a First-Person-Shooter , 2005 .

[55]  Douglas Lanman,et al.  Cascaded displays: spatiotemporal superresolution using offset pixel layers , 2014, SIGGRAPH Emerging Technologies.

[56]  Jason Jerald,et al.  The VR Book: Human-Centered Design for Virtual Reality , 2015 .

[57]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[58]  Jaron Lanier,et al.  A hand gesture interface device , 1987, CHI 1987.

[59]  Bernd Sommer,et al.  The Virtual Testbed : Latest Virtual Reality Technologies for Space Robotic Applications , 2007 .

[60]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[61]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[62]  R. Bowen Loftin,et al.  Training the Hubble space telescope flight team , 1995, IEEE Computer Graphics and Applications.

[63]  Michael Lewis,et al.  Game Engine Virtual Reality with CaveUT , 2005, Computer.

[64]  Raimund Dachselt,et al.  Three-dimensional menus: A survey and taxonomy , 2007, Comput. Graph..