Towards trustworthy automation: User interfaces that convey internal and external awareness

Suppose we are given an autonomous vehicle that has limitations, meaning that it may need to transfer control back to the human driver to guarantee safety in certain situations. This paper presents work on designing a user interface to assist this hand off by considering the effects of the expression of internal and external awareness. Internal awareness is the concept of knowing whether or not the system is confident in its ability to handle the current situation. External awareness is the concept of being able to identify the limitations as the car is driving in terms of situational anomalies. We conduct a user study to examine what information should be presented to the driver, as well as the effects of expressing these levels of awareness on the driver's situational awareness and trust in the automation. We found that expressing uncertainty about the autonomous system (internal awareness) had an adverse effect on driver experience and performance. However, by effectively conveying the automation's external awareness on the anomaly, improvements were found in the driver's situational awareness, increased trust in the system, and performance after the transfer of control.

[1]  Klaus Bengler,et al.  How Traffic Situations and Non-Driving Related Tasks Affect the Take-Over Quality in Highly Automated Driving , 2014 .

[2]  Klaus Bengler,et al.  “Take over!” How long does it take to get the driver back into the loop? , 2013 .

[3]  Mark S. Young,et al.  Attention and automation: New perspectives on mental underload and performance , 2002 .

[4]  Marika Hoedemaeker,et al.  Driver behavior in an emergency situation in the Automated Highway System , 1999 .

[5]  Michael A. Goodrich,et al.  A model of human brake initiation behavior with implications for ACC design , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[6]  Alberto L. Sangiovanni-Vincentelli,et al.  Diagnosis and Repair for Synthesis from Signal Temporal Logic Specifications , 2016, HSCC.

[7]  Lotta Jakobsson,et al.  Collision Warning with Auto Brake - A Real-Life Safety Perspective , 2007 .

[8]  Guy H. Walker,et al.  An on-road investigation of vehicle feedback and its role in driver cognition: Implications for cognitive ergonomics , 2001 .

[9]  Takayuki Kondoh,et al.  Identification of Visual Cues and Quantification of Drivers' Perception of Proximity Risk to the Lead Vehicle in Car-Following Situations , 2008 .

[10]  S. Shankar Sastry,et al.  Experimental Design for Human-in-the-Loop Driving Simulations , 2014, ArXiv.

[11]  Sanjit A. Seshia,et al.  On voting machine design for verification and testability , 2009, CCS.

[12]  John Rushby,et al.  Using model checking to help discover mode confusions and other automation surprises , 2002, Reliab. Eng. Syst. Saf..

[13]  Alberto L. Sangiovanni-Vincentelli,et al.  Data-Driven Probabilistic Modeling and Verification of Human Driver Behavior , 2014, AAAI Spring Symposia.

[14]  Wendy Ju,et al.  Emergency, Automation Off: Unstructured Transition Timing for Distracted Drivers of Automated Vehicles , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[15]  Wendy Ju,et al.  Expressing thought: Improving robot readability with animation principles , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[16]  Massimo Cellario.  Human-Centered Intelligent Vehicles: Toward Multimodal Interface Integration , 2001, IEEE Intell. Syst..

[17]  Mascha C. van der Voort,et al.  The influence of time-criticality on Situation Awareness when retrieving human control after automated driving , 2013, ITSC.

[18]  Albrecht Schmidt,et al.  Automotive user interfaces: human computer interaction in the car , 2010, CHI Extended Abstracts.

[19]  John Yen,et al.  Agents with shared mental models for enhancing team decision makings , 2006, Decis. Support Syst..

[20]  Christian P. Janssen,et al.  Multitasking in Autonomous Vehicles: Ready to Go? , 2015 .

[21]  Aaron Steinfeld,et al.  Interface lessons for fully and semi-autonomous mobile robots , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[22]  Sarah Karush.  They’re Working: Insurance Claims Data Show Which New Technologies Are Preventing Crashes , 2012 .

[23]  David Shinar,et al.  Imperfect in-vehicle collision avoidance warning systems can aid distracted drivers , 2007 .

[24]  S. Shankar Sastry,et al.  Synthesis for Human-in-the-Loop Control Systems , 2014, TACAS.

[25]  D A Norman,et al.  The 'problem' with automation: inappropriate feedback and interaction, not 'over-automation'. , 1990, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.