Using Advisory 3D Sound Cues to Improve Drivers' Performance and Situation Awareness

Within vehicle Human Machine Interface design, visual displays are predominant, taking up more and more of the visual channel for each new system added to the car, e.g. navigation systems, blind spot information and forward collision warnings. Sounds however, are mainly used to alert or warn drivers together with visual information. In this study we investigated the design of auditory displays for advisory information, by designing a 3D auditory advisory traffic information system (3DAATIS) which was evaluated in a drive simulator study with 30 participants. Our findings indicate that overall, drivers' performance and situation awareness improved when using this system. But, more importantly, the results also point towards the advantages and limitations of the use of advisory 3D-sounds in cars, e.g. attention capture vs. limited auditory resolution. These findings are discussed and expressed as design implications.

[1]  Tara Matthews,et al.  Defining, Designing, and Evaluating Peripheral Displays: An Analysis Using Activity Theory , 2007, Hum. Comput. Interact..

[2]  Sara Bly,et al.  Presenting information in sound , 1982, CHI '82.

[3]  Warren Brodsky.  Driving With Music: Cognitive-Behavioural Implications , 2015 .

[4]  Philip Kortum,et al.  HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces , 2008 .

[5]  M. A. Recarte,et al.  Mental workload while driving: effects on visual search, discrimination, and decision making. , 2003, Journal of experimental psychology. Applied.

[6]  Mads Haahr,et al.  Design, implementation and evaluation of audio for a location aware augmented reality game , 2010, Fun and Games '10.

[7]  Frans Mäyrä,et al.  Designing sound for a pervasive mobile game , 2005, ACE '05.

[8]  J. Driver,et al.  Looming sounds enhance orientation sensitivity for visual stimuli on the same side as such sounds , 2011, Experimental Brain Research.

[9]  Roger Lew,et al.  An Implementation of a Graded Deceleration Display in Brake Light Warning Systems , 2011 .

[10]  Deborah Withington.  The Use of Directional Sound to Improve the Safety of Auditory Warnings , 2000 .

[11]  Meera Blattner,et al.  Earcons and Icons: Their Structure and Common Design Principles , 1989, Hum. Comput. Interact..

[12]  Yung-Ching Liu,et al.  Effects of in-vehicle warning information displays with or without spatial compatibility on driving behaviors and response performance. , 2012, Applied ergonomics.

[13]  M. Ericson,et al.  The Intelligibility of Multiple Talkers Separated Spatially in Noise , 2001 .

[14]  Boris E. R. de Ruyter,et al.  Introduction to this Special Issue * on Awareness Systems Design , 2007 .

[15]  Heikki Summala,et al.  Towards Understanding Motivational and Emotional Factors in Driver Behaviour: Comfort Through Satisficing , 2007 .

[16]  D R Begault,et al.  Head-Up Auditory Displays for Traffic Collision Avoidance System Advisories: A Preliminary Investigation , 1993, Human factors.

[17]  Joshua D. Hoffman,et al.  Collision warning design to mitigate driver distraction , 2004, CHI.

[18]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[19]  Lynne Baillie,et al.  What's around the corner?: enhancing driver awareness in autonomous vehicles via in-vehicle spatial auditory displays , 2014, NordiCHI.

[20]  Durand R. Begault,et al.  Auditory and Non-Auditory Factors that Potentially Influence Virtual Acoustic Imagery , 1999 .

[21]  Fang Chen,et al.  How can we design 3D auditory interfaces which enhance traffic safety for Chinese drivers? , 2012, AutomotiveUI.

[22]  N D Lerner,et al.  ACOUSTIC LOCALIZATION OF IN-VEHICLE CRASH AVOIDANCE WARNINGS AS A CUE TO HAZARD DIRECTION , 1996 .

[23]  Stephen A. Brewster,et al.  Understanding concurrent earcons: Applying auditory scene analysis principles to concurrent earcon recognition , 2004, TAP.

[24]  Mica R. Endsley,et al.  Situation awareness global assessment technique (SAGAT) , 1988, Proceedings of the IEEE 1988 National Aerospace and Electronics Conference.

[25]  Fang Chen,et al.  Same, Same but Different: How Design Requirements for an Auditory Advisory Traffic Information System Differ Between Sweden and China , 2016, AutomotiveUI.

[26]  Dick de Waard,et al.  A simple procedure for the assessment of acceptance of advanced transport telematics , 1997 .

[27]  Håkan Alm,et al.  Auditory signs to support traffic awareness , 2009 .

[28]  Marcus Watson,et al.  Designing for Attention With Sound: Challenges and Extensions to Ecological Interface Design , 2007, Hum. Factors.

[29]  Rob Gray,et al.  Looming Auditory Collision Warnings for Driving , 2011, Hum. Factors.

[30]  Fang Chen,et al.  Why and How Traffic Safety Cultures Matter when Designing Advisory Traffic Information Systems , 2016, CHI.

[31]  Regan L. Mandryk,et al.  Hearing is believing: evaluating ambient audio for location-based games , 2011, Advances in Computer Entertainment Technology.