Enhancing Reality: Adaptation Strategies for AR in the Field

Situational awareness is a crucial aspect for the survivability of combat vehicles and soldiers in the battlefield, as well as for the prevention of fratricide and collateral damage. Optical, radio and acoustic sensors for monitoring the battlefield can significantly increase situational awareness by providing further information to the crew. However, in time-critical situations, a crew can encounter problems when attempting to make meaningful use of this information, as cognitive resources are otherwise occupied during other operations, e.g. controlling a vehicle. Research from various fields clearly indicates that the correct use of Augmented Reality (AR) enables the crew to pay significantly greater attention to the current tasks, while maintaining an overview of the tactical situation. Adaptation strategies for presenting AR symbols as well as a multi modal approach can be used to distribute the workload. This paper deals with the use of AR in the Field, especially in a military context. It describes the practical use of AR, the exploratory methodology for creating new cues and gives an outlook on further possible uses.

[1]  Max Jacobson,et al.  A Pattern Language: Towns, Buildings, Construction , 1981 .

[2]  Frank Flemisch,et al.  Open a Window to the Cognitive Work Process! Pointillist Analysis of Man–Machine Interaction , 2002, Cognition, Technology & Work.

[3]  Charles E. Billings,et al.  Human-Centered Aviation Automation: Principles and Guidelines , 1996 .

[4]  Sven Fuchs,et al.  Two Steps Back for One Step Forward: Revisiting Augmented Cognition Principles from a Perspective of (Social) System Theory , 2014, HCI.

[5]  Michael J. Daly,et al.  Surgeons blinded by enhanced navigation: the effect of augmented reality on attention , 2013, Surgical Endoscopy.

[6]  Christopher D. Wickens,et al.  Multiple Resources and Mental Workload , 2008, Hum. Factors.

[7]  Sven Fuchs,et al.  Validating a "Real-Time Assessment of Multidimensional User State" (RASMUS) for Adaptive Human-Computer Interaction , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[8]  Frank Flemisch,et al.  Interaction Patterns for Arbitration of Movement in Cooperative Human-Machine Systems: One-Dimensional Arbitration and Beyond , 2019, IHSI.

[9]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[10]  Frank Flemisch,et al.  Behaviour Adaptation Using Interaction Patterns with Augmented Reality Elements , 2018, HCI.

[11]  Frank Flemisch,et al.  Towards an interaction pattern language for human machine cooperation and cooperative movement , 2019, Cognition, Technology & Work.

[12]  Frank Flemisch,et al.  Interaction patterns for cooperative guidance and control: Automation mode transition in highly automated truck convoys , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[13]  Anna Schieben,et al.  Prospective Engineering of Vehicle Automation with Design Metaphors: Intermediate report from the H-Mode Projects , 2007 .

[14]  Ronald Meyer,et al.  Making HSI More Intelligent: Human Systems Exploration Versus Experiment for the Integration of Humans and Artificial Cognitive Systems , 2019, IHSI.

[15]  Schahram Dustdar,et al.  Web AR: A Promising Future for Mobile Augmented Reality—State of the Art, Challenges, and Insights , 2019, Proceedings of the IEEE.

[16]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[17]  H. Simon,et al.  How to Study Thinking in Everyday Life: Contrasting Think-Aloud Protocols With Descriptions and Explanations of Thinking , 1998 .