Virtual, Augmented and Mixed Reality. Applications and Case Studies

Advances in robotics have led to breakthroughs in several areas, including the development of humanoid robots. There are now several different models of humanoid robots available, but operating them remains a difficult challenge. Current operator control interfaces for humanoid robots often require very experienced operators and significant amounts of time for planning. A large amount of the planning and cognitive load is attributable to the operator attempting to gain adequate three-dimensional (3D) situation awareness and task awareness while viewing an interface on a flat, two-dimensional (2D) screen. Virtual reality (VR) has enormous potential to provide benefits to allow the operator to quickly and accurately understand the state of a robot in a scanned 3D environment and to issue accurate commands with less cognitive load. In the gaming sphere, VR headsets remain a new and promising interface for playing video games. In some cases, existing video games are being ported over to VR and, in others, brand new games are being designed with VR in mind. Control schemes and best practices for VR are emerging within the video game industry. This paper aims to leverage their lessons learned and to apply them to the teleoperation of

[1]  Twan Koolen,et al.  Team IHMC's Lessons Learned from the DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[2]  Nancy J. Cooke,et al.  On Teams, Teamwork, and Team Performance: Discoveries and Developments , 2008, Hum. Factors.

[3]  Jessie Y. C. Chen,et al.  Situation awareness-based agent transparency and human-autonomy teaming effectiveness , 2018 .

[4]  Albert Albers,et al.  Combined real and virtual domain product validation using top-down strategies , 2012 .

[5]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[6]  Jonathan Robinson,et al.  TurkPrime.com: A versatile crowdsourcing data acquisition platform for the behavioral sciences , 2016, Behavior Research Methods.

[7]  Ivan E. Sutherland,et al.  The Ultimate Display , 1965 .

[8]  John C. McCarthy,et al.  Technology as experience , 2004, INTR.

[9]  V. Groom,et al.  Can robots be teammates?: Benchmarks in human–robot teams , 2007 .

[10]  Timothy R. Hinkin,et al.  A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires , 1998 .

[11]  Michael J. Barnes,et al.  Issues in Human–Agent Communication , 2019 .

[12]  Ben Blachnitzky,et al.  Augmented reality , 2012, 2012 IEEE Hot Chips 24 Symposium (HCS).

[13]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[14]  A. W. Evans,et al.  Attitudes Toward Risk and Effort Tradeoffs in Human-Robot Heterogeneous Team Operations , 2018, Proceedings of the Human Factors and Ergonomics Society Annual Meeting.

[15]  Robert J. Seidel,et al.  Virtual Reality Training's Future: Perspectives on Virtual Reality and Related Emerging Technologies , 1997 .

[16]  Albert Albers,et al.  Methodische Unterstützung zur Produktvalidierung in AR-Umgebungen in der Frühen Phase der PGE – Produktgenerationsentwicklung , 2018 .

[17]  Sarah Diefenbach,et al.  Durch schnelles Scheitern zum Erfolg: Eine Frage des passenden Prototypen? , 2013, Usability Professionals.

[18]  Holly A. Yanco,et al.  Analysis of Human‐robot Interaction at the DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[19]  Jean Scholtz,et al.  Analysis of human–robot interaction at the DARPA Robotics Challenge Finals , 2017, Int. J. Robotics Res..

[20]  Clifford Nass,et al.  Computers are social actors , 1994, CHI '94.

[21]  Balakrishnan Muniandy,et al.  Exploring the Application of Augmented Reality Technology in Early Childhood Classroom in Malaysia , 2014 .

[22]  Charles van der Mast,et al.  Virtual Reality Treatment in Acrophobia: A Comparison with Exposure in Vivo , 2001, Cyberpsychology Behav. Soc. Netw..

[23]  Jessie Y. C. Chen,et al.  Human–Agent Teaming for Multirobot Control: A Review of Human Factors Issues , 2014, IEEE Transactions on Human-Machine Systems.

[24]  Erik Stolterman,et al.  The Anatomy of Prototypes , 2010 .

[25]  Kevin T. Wynne,et al.  An integrative model of autonomous agent teammate-likeness , 2018 .

[26]  B. J. Fogg,et al.  Can computers be teammates? , 1996, Int. J. Hum. Comput. Stud..

[27]  M. Pfingsten,et al.  Das Göttinger Rücken Intensiv Programm (GRIP)—ein multimodales Behandlungsprogramm für Patienten mit chronischen Rückenschmerzen, Teil 1 , 1996, Der Schmerz.

[28]  Umberto Cugini,et al.  Mixed prototyping for product assessment: a reference framework , 2009 .

[29]  Guy Pyrzak,et al.  Breaking the fidelity barrier: an examination of our current characterization of prototypes and an example of a mixed-fidelity success , 2006, CHI.

[30]  Aaron D. Ames,et al.  Valkyrie: NASA's First Bipedal Humanoid Robot , 2015, J. Field Robotics.

[31]  Philipp Mayring.  Qualitative Inhaltsanalyse : Grundlagen und Techniken , 2003 .

[32]  Charles M Oman,et al.  Virtual-reality-Based 3D navigation training for emergency egress from spacecraft. , 2007, Aviation, space, and environmental medicine.