Driver compliance to take-over requests with different auditory outputs in conditional automation.

Conditionally automated driving (CAD) systems are expected to improve traffic safety. Whenever the CAD system exceeds its limit of operation, designers of the system need to ensure a safe and timely enough transition from automated to manual mode. An existing visual Human-Machine Interface (HMI) was supplemented by different auditory outputs. The present work compares the effects of different auditory outputs in form of (1) a generic warning tone and (2) additional semantic speech output on driver behavior for the announcement of an upcoming take-over request (TOR). We expect the information carried by means of speech output to lead to faster reactions and better subjective evaluations by the drivers compared to generic auditory output. To test this assumption, N=17 drivers completed two simulator drives, once with a generic warning tone ('Generic') and once with additional speech output ('Speech+generic'), while they were working on a non-driving related task (NDRT; i.e., reading a magazine). Each drive incorporated one transition from automated to manual mode when yellow secondary lanes emerged. Different reaction time measures, relevant for the take-over process, were assessed. Furthermore, drivers evaluated the complete HMI regarding usefulness, ease of use and perceived visual workload just after experiencing the take-over. They gave comparative ratings on usability and acceptance at the end of the experiment. Results revealed that reaction times, reflecting information processing time (i.e., hands on the steering wheel, termination of NDRT), were shorter for 'Speech+generic' compared to 'Generic' while reaction time, reflecting allocation of attention (i.e., first glance ahead), did not show this difference. Subjective ratings were in favor of the system with additional speech output.

[1]  Neville A. Stanton,et al.  Human Factors in Auditory Warnings , 1999 .

[2]  Frank E. Pollick,et al.  Language-based multimodal displays for the handover of control in autonomous cars , 2015, AutomotiveUI.

[3]  S Buld,et al.  Vermeidung von Simulator Sickness anhand eines Trainings zur Gewoehnung an die Fahrsimulation / Avoidance of simulator sickness by training the adaptation to the driving simulation , 2003 .

[4]  Alexandra Neukum,et al.  Controllability of partially automated driving functions - does it matter whether drivers are allowed to take their hands off the steering wheel? , 2015 .

[5]  Alexandra Neukum,et al.  A Human-Machine Interface for Cooperative Highly Automated Driving , 2017 .

[6]  Alexandra Neukum,et al.  Your Turn or My Turn?: Design of a Human-Machine Interface for Conditional Automation , 2016, AutomotiveUI.

[7]  D. Alan Allport,et al.  SHIFTING INTENTIONAL SET - EXPLORING THE DYNAMIC CONTROL OF TASKS , 1994 .

[8]  Thomas J Triggs,et al.  Warning drivers of approaching hazards: The importance of location clues and multi-sensory cues , 2009 .

[9]  Roman Vilimek,et al.  Effects of Speech and Non-Speech Sounds on Short-Term Memory and Possible Implications for In-Vehicle Use Research paper for the ICAD05 workshop "Combining Speech and Sound in the User Interface" , 2005 .

[10]  Andrea M Philipp,et al.  Control and interference in task switching--a review. , 2010, Psychological bulletin.

[11]  Klaus Bengler,et al.  “Take over!” How long does it take to get the driver back into the loop? , 2013 .

[12]  Frank Flemisch,et al.  Towards a dynamic balance between humans and automation: authority, ability, responsibility and control in shared and cooperative control situations , 2012, Cognition, Technology & Work.

[13]  James P Bliss,et al.  Alarm mistrust in automobiles: how collision alarm reliability affects driving. , 2003, Applied ergonomics.

[14]  S. Monsell,et al.  Costs of a predictible switch between simple cognitive tasks. , 1995 .

[15]  Neville A. Stanton,et al.  Take-Over Time in Highly Automated Vehicles , 2018, Driver Reactions to Automated Vehicles.

[16]  Natasha Merat,et al.  Transition to manual: driver behaviour when resuming control from a highly automated vehicle , 2014 .

[17]  Joachim Meyer,et al.  Conceptual Issues in the Study of Dynamic Hazard Warnings , 2004, Hum. Factors.

[18]  Klaus Bengler,et al.  How Traffic Situations and Non-Driving Related Tasks Affect the Take-Over Quality in Highly Automated Driving , 2014 .

[19]  Alexandra Neukum,et al.  Speech improves human-automation cooperation in automated driving , 2016, MuC.

[20]  Alexandra Neukum,et al.  Effectiveness of advisory warnings based on cooperative perception , 2015 .

[21]  Alexandra Neukum,et al.  The effect of urgency of take-over requests during highly automated driving under distraction conditions , 2014 .

[22]  Paul Green,et al.  Safety and Usability of Speech Interfaces for In-Vehicle Tasks while Driving: A Brief Literature Review , 2006 .

[23]  Alexandra Neukum,et al.  Advisory warnings based on cooperative perception , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[24]  Josef F. Krems,et al.  Prior Familiarization With Takeover Requests Affects Drivers’ Takeover Performance and Automation Trust , 2017, Hum. Factors.

[25]  Alexandra Neukum,et al.  Cooperative warning systems: The impact of false and unnecessary alarms on drivers' compliance. , 2016, Accident; analysis and prevention.

[26]  Guy H. Walker,et al.  Human Factors in Automotive Engineering and Technology , 2017 .

[27]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[28]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[29]  Alexandra Neukum,et al.  Improving Usefulness of Automated Driving by Lowering Primary Task Interference through HMI Design , 2017 .

[30]  Klaus C. J. Dietmayer,et al.  Car2X-based perception in a high-level fusion architecture for cooperative perception systems , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[31]  Joseph F. Coughlin,et al.  Older and Younger Drivers' Reliance on Collision Warning Systems , 2001 .

[32]  William Payre,et al.  Fully Automated Driving , 2016, Hum. Factors.

[33]  Neville A. Stanton,et al.  Takeover Time in Highly Automated Vehicles: Noncritical Transitions to and From Manual Control , 2017, Hum. Factors.