Augmented Reality Displays for Communicating Uncertainty Information in Automated Driving

Safe manual driving performance following takeovers in conditionally automated driving systems is impeded by a lack in situation awareness, partly due to an inappropriate trust in the system's capabilities. Previous work has indicated that the communication of system uncertainties can aid the trust calibration process. However, it has yet to be investigated how the information is best conveyed to the human operator. The study outlined in this publication presents an interface layout to visualise function-specific uncertainty information in an augmented reality display and explores the suitability of 11 visual variables. 46 participants completed a sorting task and indicated their preference for each of these variables. The results demonstrate that particularly colour-based and animation-based variables, above all hue, convey a clear order in terms of urgency and are well-received by participants. The presented findings have implications for all augmented reality displays that are intended to show content varying in urgency.

[1]  Gudrun Klinker,et al.  Visual Longitudinal and Lateral Driving Assistance in the Head-Up Display of Cars , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[2]  Christopher G. Healey,et al.  Visualizing data with motion , 2005, VIS 05. IEEE Visualization, 2005..

[3]  Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles , 2022 .

[4]  Łukasz Halik.  The analysis of visual variables for use in the cartographic design of point symbols for mobile Augmented Reality applications , 2012 .

[5]  Edgar Brunner,et al.  Nonparametric analysis of longitudinal data in factorial experiments , 2012 .

[6]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[7]  Lu Wang,et al.  Trust and Reliance on an Automated Combat Identification System , 2009, Hum. Factors.

[8]  Justin G. Hollands,et al.  Beyond Identity: Incorporating System Reliability Information Into an Automated Combat Identification System , 2011, Hum. Factors.

[9]  Rüdiger Heimgärtner,et al.  Cultural User Experience in the Car—Toward a Standardized Systematic Intercultural Agile Automotive UI/UX Design Process , 2017 .

[10]  Bruce N. Walker,et al.  Development and Preliminary Evaluation of Reliability Displays for Automated Lane Keeping , 2017, AutomotiveUI.

[11]  Boris Israel.  Potenziale eines kontaktanalogen Head-up Displays für den Serieneinsatz , 2013 .

[12]  W. Hays.  Semiology of Graphics: Diagrams Networks Maps. , 1985 .

[13]  Nadine B. Sarter,et al.  Supporting Trust Calibration and the Effective Use of Decision Aids by Presenting Dynamic System Confidence Information , 2006, Hum. Factors.

[14]  Mark Vollrath,et al.  Improving the Driver–Automation Interaction , 2013, Hum. Factors.

[15]  Josef Affenzeller.  ERTRAC: The European Road Transport Research Advisory Council , 2017 .

[16]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[17]  Philipp Wintersberger,et al.  Traffic Augmentation as a Means to Increase Trust in Automated Driving Systems , 2017, CHItaly.

[18]  Markus Lienkamp,et al.  A system design for automotive augmented reality using stereo night vision , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[19]  Stephen Rice,et al.  System-Wide versus Component-Specific Trust Using Multiple Aids , 2009, The Journal of general psychology.

[20]  Alan M. MacEachren,et al.  VISUALIZING UNCERTAIN INFORMATION , 1992 .

[21]  Byoung-Jun Park,et al.  Augmented reality and representation in vehicle for safe driving at night , 2015, 2015 International Conference on Information and Communication Technology Convergence (ICTC).

[22]  Colin Ware.  Visual Salience and Finding Information , 2012 .

[23]  Mark Gahegan,et al.  Visualizing Geospatial Information Uncertainty: What We Know and What We Need to Know , 2005 .

[24]  James T. Enns,et al.  Large Datasets at a Glance: Combining Textures and Colors in Scientific Visualization , 1999, IEEE Trans. Vis. Comput. Graph..

[25]  Alexander Kunze,et al.  Enhancing Driving Safety and User Experience Through Unobtrusive and Function-Specific Feedback , 2017, AutomotiveUI.

[26]  David R. Large,et al.  A Longitudinal Simulator Study to Explore Drivers’ Behaviour During Highly-Automated Driving , 2017 .

[27]  Josef F. Krems,et al.  Keep Your Scanners Peeled , 2016, Hum. Factors.

[28]  Ann M. Bisantz,et al.  Utilizing Graphical Formats to Convey Uncertainty in a Decision Making Task , 2000 .

[29]  Gary E. Burnett,et al.  Visual search tasks: the effects of head-up displays on driving and task performance , 2015, AutomotiveUI.

[30]  Jos Feys,et al.  Nonparametric Tests for the Interaction in Two-way Factorial Designs Using R , 2016, R J..

[31]  M. S. T. Carpendale,et al.  Considering Visual Variables as a Basis for Information Visualisation , 2003 .

[32]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[33]  Alex T. Pang,et al.  Approaches to uncertainty visualization , 1996, The Visual Computer.

[34]  Mark Gahegan,et al.  Visual Semiotics & Uncertainty Visualization: An Empirical Study , 2012, IEEE Transactions on Visualization and Computer Graphics.

[35]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[36]  M. Greenwood.  An Introduction to Medical Statistics , 1932, Nature.

[37]  A Treisman,et al.  Feature analysis in early vision: evidence from search asymmetries. , 1988, Psychological review.

[38]  Göran Falkman,et al.  Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving , 2013, AutomotiveUI.

[39]  B. Julesz,et al.  Human factors and behavioral science: Textons, the fundamental elements in preattentive vision and perception of textures , 1983, The Bell System Technical Journal.

[40]  Jacob P. Somervell,et al.  A model for notification systems evaluation—assessing user goals for multitasking activity , 2003, TCHI.

[41]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[42]  Stephen Rice,et al.  Using System-Wide Trust Theory to Reveal the Contagion Effects of Automation False Alarms and Misses on Compliance and Reliance in a Simulated Aviation Task , 2013 .

[43]  Raja Parasuraman,et al.  Complacency and Bias in Human Use of Automation: An Attentional Integration , 2010, Hum. Factors.

[44]  Regina A. Pomranky,et al.  The role of trust in automation reliance , 2003, Int. J. Hum. Comput. Stud..

[45]  Masooda Bashir,et al.  Trust in Automation , 2015, Hum. Factors.

[46]  James T. Enns,et al.  Attention and Visual Memory in Visualization and Computer Graphics , 2012, IEEE Transactions on Visualization and Computer Graphics.