Utilizing Steering Entropy as a Measure of Performance in Head-mounted Augmented Reality

The next phase of augmented reality (AR) technologies suggest that as both the hardware and software continue to improve, we can expect that AR will become more commonly used as a tool for a variety of applications in complex operational contexts (i.e. training, manufacturing, mission planning). As new applications are designed and developed within these contexts, there is a necessity to be able to measure the effectiveness of these systems and to understand their impact on human performance and workload, so that only the most appropriate designs are selected for use, growing the technology in usefulness, not novel hindrances. A unique opportunity presented by the Microsoft HoloLens platform, as an example of head-worn AR systems, is the ability to collect positional and movement data, which lends itself to the computation of behavioral (or steering) entropy data, which can be related to human workload and performance within the system environment. However, little reference exists to be able to verify the accuracy of tracking of the device with regards to the output data available for collection. Within this practitioner-oriented paper, we extend current entropy measurement theory typically used in control settings within a heads-up display type ‘controls' environment. Our findings indicate that in-situ measurements of entropy utilizing the onboard sensors within the AR platform are more accurate to those collected within a Motion Capture Facility. Extending this work, these measurements can be used as a correlate of performance.

[1]  Mica R. Endsley,et al.  Situation awareness global assessment technique (SAGAT) , 1988, Proceedings of the IEEE 1988 National Aerospace and Electronics Conference.

[2]  J. Edward Swan,et al.  Objective measures for the effectiveness of augmented reality , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[3]  Andrew Parkes,et al.  STEERING ENTROPY AS A MEASURE OF IMPAIRMENT , 2004 .

[4]  Michael A. Goodrich,et al.  Behavioral Entropy in Human-Robot Interaction , 2004 .

[5]  R. Gray Entropy and Information Theory , 1990, Springer New York.

[6]  Guang-Zhong Yang,et al.  A stereoscopic fibroscope for camera motion and 3D depth recovery during Minimally Invasive Surgery , 2009, 2009 IEEE International Conference on Robotics and Automation.

[7]  Frank Biocca,et al.  Attention Issues in Spatial Information Systems: Directing Mobile Users' Visual Attention Using Augmented Reality , 2007, J. Manag. Inf. Syst..

[8]  Kelly A. Sprehn,et al.  Augmented Reality Design Heuristics: Designing for Dynamic Interactions , 2017 .

[9]  Ali Pourmand,et al.  Videogame-Related Illness and Injury: A Review of the Literature and Predictions for Pokémon GO! , 2017, Games for health journal.

[10]  Merriam Webster Merriam-Webster's Collegiate Dictionary , 2016 .

[11]  Erwin R. Boer,et al.  Development of a steering entropy method for evaluating driver workload , 1999 .

[12]  V. C. Abrahams The physiology of neck muscles; their role in head movement and maintenance of posture. , 1977, Canadian Journal of Physiology and Pharmacology.