On the Necessity and Feasibility of Detecting a Driver's Emotional State While Driving

This paper brings together two important aspects of the human-machine interaction in cars: the psychological aspect and the engineering aspect. The psychologically motivated part of this study addresses questions such as whyit is important to automatically assess the driver's affective state, which states are important and how a machine's response should look like. The engineering part studies howthe emotional state of a driver can be estimated by extracting acoustic features from the speech signal and mapping them to an emotion state in a multidimensional, continuous-valued emotion space. Such a feasibility study is performed in an experiment in which spontaneous, authentic emotional utterances are superimposed by car noise of several car types and various road surfaces.

[1]  Clifford Nass,et al.  Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship , 2005 .

[2]  T. Galovski,et al.  ROAD RAGE: A DOMAIN FOR PSYCHOLOGICAL INTERVENTION? , 2004 .

[3]  Hans Wilhelm Schüßler.  Digitale Signalverarbeitung 1 , 1994 .

[4]  Ludwing Hitzenberger.  Man machine interaction in car information systems , 1998, LREC.

[5]  M. Shipp.  Understanding Driving: Applying Cognitive Psychology to a Complex Everyday Task , 2001 .

[6]  Clifford Nass,et al.  Improving automotive safety by pairing driver emotion and car voice emotion , 2005, CHI Extended Abstracts.

[7]  Clifford Nass,et al.  Speech interfaces from an evolutionary perspective , 2000, CACM.

[8]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[9]  B. Schuller,et al.  Recognition of Spontaneous Emotions by Speech within Automotive Environment , 2006 .

[10]  M. Csíkszentmihályi.  Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990. , 1990 .

[11]  George N. Votsis,et al.  Emotion recognition in human-computer interaction , 2001, IEEE Signal Process. Mag..

[12]  R J Melton,et al.  Processing goals, task interest, and the mood-performance relationship: a mediational analysis. , 1996, Journal of personality and social psychology.

[13]  Philip Barker.  Wired for Speech: How Voice Activates the Human‐Computer Relationship , 2006 .

[14]  Shrikanth S. Narayanan,et al.  Support Vector Regression for Automatic Recognition of Spontaneous Emotions in Speech , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[15]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[16]  Vladimir Cherkassky,et al.  The Nature Of Statistical Learning Theory , 1997, IEEE Trans. Neural Networks.

[17]  W C Dement,et al.  The perils of drowsy driving. , 1997, The New England journal of medicine.

[18]  K.-D. Kammeyer,et al.  Digitale Signalverarbeitung - Filterung und Spektralanalyse , 1989 .

[19]  K. Kroschel,et al.  Evaluation of natural emotions using self assessment manikins , 2005, IEEE Workshop on Automatic Speech Recognition and Understanding, 2005..

[20]  A. Isen,et al.  The Influence of Positive Affect on Clinical Problem solving , 1991, Medical decision making : an international journal of the Society for Medical Decision Making.

[21]  K. Kroschel,et al.  RULE-BASED EMOTION CLASSIFICATION USING ACOUSTIC FEATURES , .

[22]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[23]  Shrikanth S. Narayanan,et al.  Primitives-based evaluation and estimation of emotions in speech , 2007, Speech Commun..

[24]  Björn Schuller,et al.  Emotion Recognition in the Noise Applying Large Acoustic Feature Sets , 2006 .

[25]  Tim Fingscheidt,et al.  Robust speech recognition for mobile devices in car noise , 2005, INTERSPEECH.

[26]  Ing-Marie Jonsson,et al.  Automatic recognition of affective cues in the speech of car drivers to allow appropriate responses , 2005, OZCHI.

[27]  B. Detenber,et al.  A Bio‐Informational Theory of Emotion: Motion and Image Size Effects on Viewers , 1996 .