Tutorial on In-vehicle Auditory Interactions: Design and Application of Auditory Displays, Speech, Sonification, & Music

This tutorial presents an overview of the in-vehicle auditory interactions, including theoretical background, design considerations, and practical design procedure and guidelines based on the authors' experience in sound design and automotive user interface design, and the Mind Music Machine Lab's research on both topics. The tutorial will be composed of four sessions: auditory menu navigation, speech interactions, music & sonification, and sonic branding. Particularly, in each session hands-on activities will be conducted first and then, a short lecture on the topic will be followed. This tutorial aims to inspire practitioners as well as researchers to appropriately apply auditory displays and sonification to in-vehicle technologies, and thus, facilitate necessary multi-tasking processes in automotive user interfaces.

[1]  Bruce N. Walker,et al.  Auditory Displays for In-Vehicle Technologies: , 2011 .

[2]  J. Gross.  Emotion regulation: affective, cognitive, and social consequences. , 2002, Psychophysiology.

[3]  Björn W. Schuller,et al.  Emotion on the Road - Necessity, Acceptance, and Feasibility of Affective Computing in the Car , 2010, Adv. Hum. Comput. Interact..

[4]  Clifford Nass,et al.  Emotion regulation for frustrating driving contexts , 2011, CHI.

[5]  Meera Blattner,et al.  Earcons and Icons: Their Structure and Common Design Principles , 1989, Hum. Comput. Interact..

[6]  Myounghoon Jeon,et al.  Spindex (Speech Index) Improves Auditory Menu Acceptance and Navigation Performance , 2011, TACC.

[7]  Clifford Nass,et al.  Thank you, I did not see that: in-car speech based information systems for older adults , 2005, CHI Extended Abstracts.

[8]  Stephen Brewster,et al.  Using non-speech sound to overcome information overload , 1997 .

[9]  Myounghoon Jeon.  Lyricons (Lyrics + Earcons): Designing a New Auditory Cue Combining Speech and Sounds , 2013, HCI.

[10]  Myounghoon Jeon,et al.  Ergonomics Society of the Human Factors and Human Factors: The Journal , 2012 .

[11]  Myounghoon Jeon,et al.  The effects of social interactions with in-vehicle agents on a driver's anger level, driving performance, situation awareness, and perceived workload. , 2015, Applied ergonomics.

[12]  Clifford Nass,et al.  Improving automotive safety by pairing driver emotion and car voice emotion , 2005, CHI Extended Abstracts.

[13]  William W. Gaver.  Auditory Icons: Using Sound in Computer Interfaces , 1986, Hum. Comput. Interact..

[14]  Myounghoon Jeon,et al.  Listen To Your Drive: Sonification Architecture and Strategies for Driver State and Performance , 2016, ICAD 2016.

[15]  M. D’Esposito.  Working memory. , 2008, Handbook of clinical neurology.

[16]  Myounghoon Jeon,et al.  If You're Angry, Turn the Music on: Music Can Mitigate Anger Effects on Driving Performance , 2014, AutomotiveUI.

[17]  Ephraim P. Glinert,et al.  An experiment into the use of auditory cues to reduce visual workload , 1989, CHI '89.

[18]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .