Voices in Self-Driving Cars Should be Assertive to More Quickly Grab a Distracted Driver's Attention

Automated driving will mean that people can engage in other activities and an important concern will be how to alert the driver to critical events that require their intervention. This study evaluates how various levels of assertiveness of voice command in a semi-AV and different degrees of immersion of a non-driving task may affect people's attention on the road. In a simulated set-up, 20 participants were required to execute actions on the steering wheel when a voice command was given while playing a mobile game. Regardless of how immersed the driver was in the game, a more assertive voice resulted in faster reaction time to the instructions and was perceived as more urgent than a less assertive voice. Automotive systems should use an assertive voice to effectively grab people's attention. This is effective even when they are engaged in an immersive secondary task.

[1]  Andrew Howes,et al.  A cognitive constraint model of dual-task trade-offs in a highly dynamic driving task , 2007, CHI.

[2]  David R. Large,et al.  Drivers’ preferences and emotional responses to satellite navigation voices , 2013 .

[3]  Carryl L. Baldwin.  Verbal collision avoidance messages during simulated driving: perceived urgency, alerting effectiveness and annoyance , 2011, Ergonomics.

[4]  Frederik Diederichs,et al.  Take-Over Requests for Automated Driving , 2015 .

[5]  Frank E. Pollick,et al.  Language-based multimodal displays for the handover of control in autonomous cars , 2015, AutomotiveUI.

[6]  R. Barthes,et al.  Image-Music-Text , 1977 .

[7]  Klaus Bengler,et al.  “Take over!” How long does it take to get the driver back into the loop? , 2013 .

[8]  Craig A. Giffi,et al.  A reality check on advanced vehicle technologies , 2018 .

[9]  Wendy Ju,et al.  Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance , 2014, International Journal on Interactive Design and Manufacturing (IJIDeM).

[10]  Catherine M. Burns,et al.  Autonomous Driving in the Real World: Experiences with Tesla Autopilot and Summon , 2016, AutomotiveUI.

[11]  Duncan P. Brumby,et al.  "Watch Out!": Semi-Autonomous Vehicles Using Assertive Voices to Grab Distracted Drivers' Attention , 2019, CHI Extended Abstracts.

[12]  Feng Xia,et al.  Vehicular Social Networks: Enabling Smart Mobility , 2017, IEEE Communications Magazine.

[13]  K. Scherer.  Personality inference from voice quality: The loud voice of extroversion. , 1978 .

[14]  Christopher D. Wickens,et al.  Multiple Resources and Mental Workload , 2008, Hum. Factors.

[15]  L. Streeter,et al.  Effects of Pitch and Speech Rate on Personal Attributions , 1979 .

[16]  Andrew Howes,et al.  Focus on driving: how cognitive constraints shape the adaptation of strategy when dialing while driving , 2009, CHI.

[17]  Paul A. Cairns,et al.  Measuring and defining the experience of immersion in games , 2008, Int. J. Hum. Comput. Stud..

[18]  Carryl L. Baldwin,et al.  Perceived Urgency, Alerting Effectiveness and Annoyance of Verbal Collision Avoidance System Messages , 2002 .

[19]  Lutz Lorenz,et al.  Designing take over scenarios for automated driving , 2014 .

[20]  Niels Taatgen,et al.  What Makes Interruptions Disruptive?: A Process-Model Account of the Effects of the Problem State Bottleneck on Task Interruption and Resumption , 2015, CHI.

[21]  Kathrin Zeeb,et al.  What determines the take-over time? An integrated model approach of driver take-over after automated driving. , 2015, Accident; analysis and prevention.

[22]  Khalil Sima'an,et al.  Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship , 2006, Computational Linguistics.

[23]  Shamsi T. Iqbal,et al.  Priming Drivers before Handover in Semi-Autonomous Cars , 2017, CHI.

[24]  Lee Skrypchuk,et al.  Steering the conversation: A linguistic exploration of natural language interactions with a digital assistant during simulated driving. , 2017, Applied ergonomics.

[25]  Jeffery Pittam.  Voice in social interaction , 1994 .

[26]  Eric Horvitz,et al.  Hang on a sec!: effects of proactive mediation of phone conversations while driving , 2011, CHI.

[27]  Judy Edworthy,et al.  Acoustic, semantic and phonetic influences in spoken warning signal words , 2003 .

[28]  Duncan P. Brumby,et al.  Game & Watch: Are "Let's Play" Gaming Videos as Immersive as Playing Games? , 2017, CHI PLAY.

[29]  Clifford Nass,et al.  Computers are social actors , 1994, CHI '94.

[30]  J. Lerner,et al.  Trust Your Gut or Think Carefully? Examining Whether an Intuitive, Versus a Systematic, Mode of Thought Produces Greater Empathic Accuracy , 2016, Journal of personality and social psychology.

[31]  Clifford Nass,et al.  Thank you, I did not see that: in-car speech based information systems for older adults , 2005, CHI Extended Abstracts.

[32]  Tobias Vogelpohl,et al.  Transitioning to manual driving requires additional time after automation deactivation , 2018 .

[33]  Joseph P. Olive.  The talking computer: text to speech synthesis , 2001 .