Using Paralinguistic Cues in Speech to Recognise Emotions in Older Car Drivers

Interactive speech based systems are moving into the car since speech interactions are considered less detrimental to the driver than interactions with a display. The introduction of in-car speech-based interactions highlights the potential influence of linguistic and paralinguistic cues such as emotion. Emotions direct and focus people's attention on objects and situations, and affects performance, judgment and risk-taking. All of these properties are crucial for driving where the smallest slip-up can have grave repercussions. Emotional cues in a car-voice, paired with the emotional state of the driver, have been found to influence driving performance. This initiated the design of an in-car driver emotion detection and response system. Results show that the in-car system can recognise and track changes in the emotional state of the driver. This study considers older drivers who often feel both unsafe and insecure due to concerns about declining abilities and in particular vision.

[1]  Richard S. Lehman,et al.  The effects of distraction and age on reaction time in a driving simulator , 2010 .

[2]  A. Isen,et al.  Positive affect and decision making. , 1993 .

[3]  S. Pinker The Language Instinct , 1994 .

[4]  George N. Votsis,et al.  Emotion recognition in human-computer interaction , 2001, IEEE Signal Process. Mag..

[5]  Clifford Nass,et al.  Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent , 2005, Int. J. Hum. Comput. Stud..

[6]  J. Harackiewicz,et al.  Processing goals, task interest, and the mood–performance relationship: A mediational analysis. , 1996 .

[7]  David L. Strayer,et al.  Driven to Distraction: Dual-Task Studies of Simulated Driving and Conversing on a Cellular Telephone , 2001, Psychological science.

[8]  Clifford Nass,et al.  Improving automotive safety by pairing driver emotion and car voice emotion , 2005, CHI Extended Abstracts.

[9]  J. Gross Antecedent- and response-focused emotion regulation: divergent consequences for experience, expression, and physiology. , 1998, Journal of personality and social psychology.

[10]  Rosalind W. Picard Affective Computing , 1997 .

[11]  J. Mullennix,et al.  Effects of Variation in Emotional Tone of Voice on Speech Perception , 2002, Language and speech.

[12]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[13]  W. Brouwer,et al.  Age differences in divided attention in a simulated driving task. , 1988, Journal of gerontology.

[14]  H. Lunenfeld Human factor considerations of motorist navigation and information systems , 1989, Conference Record of papers presented at the First Vehicle Navigation and Information Systems Conference (VNIS '89).

[15]  Ing-Marie Jonsson,et al.  Performance Analysis of Acoustic Emotion Recognition for In-Car Conversational Interfaces , 2007, HCI.

[16]  L. F. Barrett,et al.  Handbook of Emotions , 1993 .

[17]  C. Nass,et al.  Emotion in human-computer interaction , 2002 .