Blending the Best of the Real with the Best of the Virtual: Mixed Reality Case Studies in Healthcare and Defence

The resurgence of interest in the fields of Virtual, Augmented and, more recently, Mixed Reality (VR, AR and MxR) is—as was first witnessed in the 1990s—demonstrating the challenges and pitfalls facing interactive systems developers and adopters when confronted with a myriad of potential “high-tech” solutions from an increasingly saturated product marketplace. Adding to the confusion is the increase in appearance of regular online news features and commentaries claiming, for example, that AR is, or will be “superior” in some way to VR (and vice versa), or that MxR will outperform both. Yet, despite this confused state of affairs, there has, over the past two to three decades, been a growing body of evidence confirming that the disciplines of Human Factors (HF) or Human-Centred Design have an indispensable role to play in the choice and subsequent exploitation of these technologies for a wide range of real-world applications. This paper sets out to emphasise the importance of adopting HF techniques and knowledge when developing VR, AR and MxR, and presents a number of relevant MxR case studies in defence and healthcare to support the key premises presented.

[1]  Robert J. Stone,et al.  SubSafe: a games-based training system for submarine safety and spatial awareness (Part 1) , 2009, Virtual Reality.

[2]  Robert J Stone,et al.  A ‘mixed reality’ simulator concept for future Medical Emergency Response Team training , 2017, Journal of the Royal Army Medical Corps.

[3]  Kaija Saranto,et al.  A Paramedic Field Supervisor's Situational Awareness in Prehospital Emergency Care , 2014, Prehospital and Disaster Medicine.

[4]  Robert J. Stone Getting VR Right Then and Now . . . The Indispensable Role of Human Factors and Human-Centered Design , 2016, PRESENCE: Teleoperators and Virtual Environments.

[5]  Neville A. Stanton,et al.  From wearable computers to surgical training: The human factors integration defence technology centre , 2006 .

[6]  Robert Stone,et al.  An inexpensive underwater mine countermeasures simulator with real-time 3D after action review , 2016 .

[7]  Christian Geiger,et al.  Multi-Modal, Multi-Touch Interaction with Maps in Disaster Management Applications , 2012 .

[8]  Robert J Stone,et al.  The (human) science of medical virtual learning environments , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[9]  Oren Zuckerman,et al.  To TUI or not to TUI: Evaluating performance and preference in tangible vs. graphical user interfaces , 2013, Int. J. Hum. Comput. Stud..

[10]  Harvey S. Smallman,et al.  'Symbicons': A Hybrid Symbology That Combines the Best Elements of Symbols and Icons , 2001 .

[11]  James D. Hollan,et al.  Augmenting Interactive Tabletops with Translucent Tangible Controls , 2010, Tabletops.