Conveying Uncertainties Using Peripheral Awareness Displays in the Context of Automated Driving

As a consequence of insufficient situation awareness and inappropriate trust, operators of highly automated driving systems may be unable to safely perform takeovers following system failures. The communication of system uncertainties has been shown to alleviate these issues by supporting trust calibration. However, the existing approaches rely on information presented in the instrument cluster and therefore require users to regularly shift their attention between road, uncertainty display, and non-driving related tasks. As a result, these displays have the potential to increase workload and the likelihood of missed signals. A driving simulator study was conducted to compare a digital uncertainty display located in the instrument cluster with a peripheral awareness display consisting of a light strip and vibro-tactile seat feedback. The results indicate that the latter display affords users flexibility to direct more attention towards the road prior to critical situations and leads to lower workload scores while improving takeover performance.

[1]  Klaus Bengler,et al.  “Take over!” How long does it take to get the driver back into the loop? , 2013 .

[2]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[3]  Bryan Reimer,et al.  Glass half-full: On-road glance metrics differentiate crashes from near-crashes in the 100-Car data. , 2017, Accident; analysis and prevention.

[4]  Tara Matthews,et al.  A toolkit for managing user attention in peripheral displays , 2004, UIST '04.

[5]  Toshiyuki Inagaki,et al.  Attention and complacency , 2000 .

[6]  Tom A. B. Snijders,et al.  Multilevel Analysis , 2011, International Encyclopedia of Statistical Science.

[7]  P. Brockhoff,et al.  Tests in Linear Mixed Effects Models , 2015 .

[8]  Colin G. Drury,et al.  Foundations for an Empirically Determined Scale of Trust in Automated Systems , 2000 .

[9]  Jacques M. B. Terken,et al.  Compatibility between Trust and Non-Driving Related Tasks in UI Design for Highly and Fully Automated Driving , 2016, AutomotiveUI.

[10]  E. Bartha,et al.  Altered lymphocyte acetylcholinesterase activity in patients with senile dementia , 1987, Neuroscience Letters.

[11]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[12]  Ralph Helmar Rasshofer,et al.  Influences of weather phenomena on automotive laser radar systems , 2011 .

[13]  N. Sadat Shami,et al.  Context of Use Evaluation of Peripheral Displays (CUEPD) , 2005, INTERACT.

[14]  Moritz Körber,et al.  Introduction matters: Manipulating trust in automation and reliance in automated driving. , 2018, Applied ergonomics.

[15]  Mark Weiser,et al.  Designing Calm Technology , 2004 .

[16]  Thomas Maier,et al.  Driver Support by a Vibrotactile Seat Matrix – Recognition, Adequacy and Workload of Tactile Patterns in Take-over Scenarios During Automated Driving☆ , 2015 .

[17]  Donald A. Norman,et al.  The Human Side of Automation , 2015 .

[18]  Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles , 2022 .

[19]  Susanne Boll,et al.  Assisting Drivers with Ambient Take-Over Requests in Highly Automated Driving , 2016, AutomotiveUI.

[20]  T. Dingus,et al.  Distracted driving and risk of road crashes among novice and experienced drivers. , 2014, The New England journal of medicine.

[21]  Tara Matthews,et al.  Defining, Designing, and Evaluating Peripheral Displays: An Analysis Using Activity Theory , 2007, Hum. Comput. Interact..

[22]  Natasha Merat,et al.  Control Task Substitution in Semiautomated Driving , 2012, Hum. Factors.

[23]  J. R. Hubbard,et al.  Handbook of Stress Medicine: An Organ System Approach , 1997 .

[24]  Hiroshi Ishii,et al.  Ambient Displays: Turning Architectural Space into an Interface between People and Digital Information , 1998, CoBuild.

[25]  Yong Gu Ji,et al.  Haptic perceptions in the vehicle seat , 2011 .

[26]  A Steptoe,et al.  Methodology of mental stress testing in cardiovascular research. , 1991, Circulation.

[27]  D. Bates,et al.  Linear Mixed-Effects Models using 'Eigen' and S4 , 2015 .

[28]  Frank E. Pollick,et al.  Language-based multimodal displays for the handover of control in autonomous cars , 2015, AutomotiveUI.

[29]  Manfred Tscheligi,et al.  ChaseLight: ambient LED stripes to control driving speed , 2015, AutomotiveUI.

[30]  Alexander Kunze,et al.  Enhancing Driving Safety and User Experience Through Unobtrusive and Function-Specific Feedback , 2017, AutomotiveUI.

[31]  Alexander Kunze,et al.  Evaluation of Variables for the Communication of Uncertainties Using Peripheral Awareness Displays , 2018, AutomotiveUI.

[32]  James T. Enns,et al.  Attention and Visual Memory in Visualization and Computer Graphics , 2012, IEEE Transactions on Visualization and Computer Graphics.

[33]  Anind K. Dey,et al.  Heuristic evaluation of ambient displays , 2003, CHI '03.

[34]  Guy H. Walker,et al.  State-of-science: situation awareness in individuals, teams and systems , 2017, Ergonomics.

[35]  Susanne Boll,et al.  Peripheral Light Cues for In-Vehicle Task Resumption , 2016, NordiCHI.

[36]  Susanne Boll,et al.  Supporting lane change decisions with ambient light , 2015, AutomotiveUI.

[37]  M. Loeb,et al.  The Psychology of Vigilance , 1982 .

[38]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[39]  Stefan Schneegaß,et al.  Design Guidelines for Reliability Communication in Autonomous Vehicles , 2018, AutomotiveUI.

[40]  John T. Stasko,et al.  Personalized Peripheral Information Awareness Through Information Art , 2004, UbiComp.

[41]  John T. Stasko,et al.  A taxonomy of ambient information systems: four patterns of design , 2006, AVI '06.

[42]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[43]  Neville A. Stanton,et al.  Detection of new in-path targets by drivers using Stop & Go Adaptive Cruise Control. , 2011, Applied ergonomics.

[44]  Robert L. Mason,et al.  Statistical Principles in Experimental Design , 2003 .

[45]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[46]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[47]  Raja Parasuraman,et al.  Complacency and Bias in Human Use of Automation: An Attentional Integration , 2010, Hum. Factors.

[48]  Thomas A. Dingus,et al.  The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data , 2006 .

[49]  Alexander Kunze,et al.  Automation transparency: implications of uncertainty communication for human-automation interaction and interfaces , 2019, Ergonomics.

[50]  Alexander Kunze,et al.  Preliminary Evaluation of Variables for Communicating Uncertainties Using a Haptic Seat , 2018, AutomotiveUI.

[51]  Wonil Hwang,et al.  Haptic Seat Interfaces for Driver Information and Warning Systems , 2011, Int. J. Hum. Comput. Interact..

[52]  Rebecca L Olson,et al.  The Impact of Hand-Held and Hands-Free Cell Phone Use on Driving Performance and Safety-Critical Event Risk , 2013 .

[53]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[54]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[55]  D. Scott McCrickard,et al.  Attuning notification design to user goals and attention costs , 2003, Commun. ACM.

[56]  Jacob P. Somervell,et al.  A model for notification systems evaluation—assessing user goals for multitasking activity , 2003, TCHI.

[57]  Natasha Merat,et al.  Coming back into the loop: Drivers' perceptual-motor performance in critical events after automated driving. , 2017, Accident; analysis and prevention.

[58]  Thomas J Triggs,et al.  Driver distraction: the effects of concurrent in-vehicle tasks, road environment complexity and age on driving performance. , 2006, Accident; analysis and prevention.

[59]  Sebastiaan M. Petermeijer,et al.  Take-over requests in highly automated driving: A crowdsourcing survey on auditory, vibrotactile, and visual displays , 2018, Transportation Research Part F: Traffic Psychology and Behaviour.

[60]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[61]  Mark R. Lehto,et al.  Foundations for an Empirically Determined Scale of Trust in Automated Systems , 2000 .

[62]  S. Yantis,et al.  Visual Attention: Bottom-Up Versus Top-Down , 2004, Current Biology.

[63]  Göran Falkman,et al.  Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving , 2013, AutomotiveUI.

[64]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[65]  Mica R. Endsley,et al.  From Here to Autonomy , 2017, Hum. Factors.

[66]  Klaus Bengler,et al.  Measurement of momentary user experience in an automotive context , 2013, AutomotiveUI.

[67]  Bruce N. Walker,et al.  Development and Preliminary Evaluation of Reliability Displays for Automated Lane Keeping , 2017, AutomotiveUI.

[68]  Raja Parasuraman,et al.  Monitoring an Automated System for a Single Failure: Vigilance and Task Complexity Effects , 1996 .

[69]  Alexander Kunze,et al.  Augmented Reality Displays for Communicating Uncertainty Information in Automated Driving , 2018, AutomotiveUI.

[70]  David R. Large,et al.  A Longitudinal Simulator Study to Explore Drivers’ Behaviour During Highly-Automated Driving , 2017 .

[71]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .