Driver behavior analysis through speech emotion understanding

Driver behavior is indeed one of the major factors contributing to high number of motor vehicle accidents. Due to the fact that human behavior is always influenced by emotion and emotion can be detected through speech, we attempt to find correlation between driver behavior state and speech emotion to analyze driver behavior. This understanding is important to facilitate the development of driver emotional indicator system that can act as some kind of warning system to prevent accidents. Experimental results show potential for driver behavior state detection particularly for sleepy state based on speech emotion recognition approach coupled with fundamental understanding of affection space model. These findings surged us to propose an alternative approach of speech emotion profiling that complement the research mainstream of driver behavior and speech emotion recognition.

[1]  Randolph R. Cornelius,et al.  The science of emotion: Research and tradition in the psychology of emotion. , 1997 .

[2]  Abdul Wahab,et al.  CMAC for speech emotion profiling , 2009, INTERSPEECH.

[3]  Abdul Wahab,et al.  Real Time Driving Data Collection and Driver Verification using CMAC-MFCC , 2008, IC-AI.

[4]  T. Bellet,et al.  A theoretical and methodological framework for studying and modelling drivers’ mental representations , 2009 .

[5]  Chris Baber,et al.  Towards a definition and working model of stress and its effects on speech , 1996, Speech Commun..

[6]  J. Groeger,et al.  Do emotional appraisals of traffic situations influence driver behaviour , 2006 .

[7]  Astrid Paeschke,et al.  A database of German emotional speech , 2005, INTERSPEECH.

[8]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[9]  H. Schlosberg Three dimensions of emotion. , 1954, Psychological review.

[10]  G. Clore,et al.  How emotions inform judgment and regulate thought , 2007, Trends in Cognitive Sciences.

[11]  W. Cannon The James-Lange theory of emotions: a critical examination and an alternative theory. By Walter B. Cannon, 1927. , 1927, The American journal of psychology.

[12]  Hiok Chai Quek,et al.  GenSoFNN: a generic self-organizing fuzzy neural network , 2002, IEEE Trans. Neural Networks.

[13]  Clifford Nass,et al.  Improving automotive safety by pairing driver emotion and car voice emotion , 2005, CHI Extended Abstracts.

[14]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[15]  Nikos Fakotakis,et al.  Comparative Evaluation of Various MFCC Implementations on the Speaker Verification Task , 2007 .

[16]  W. Cannon The James-Lange theory of emotions: a critical examination and an alternative theory. By Walter B. Cannon, 1927. , 1927, American Journal of Psychology.

[17]  Hiok Chai Quek,et al.  DIC: A Novel Discrete Incremental Clustering Technique for the Derivation of Fuzzy Membership Functions , 2002, PRICAI.

[18]  Abdul Wahab,et al.  Features extraction for speech emotion , 2008, J. Comput. Methods Sci. Eng..