A real time classifier for emotion and stress recognition in a vehicle driver

Recently there is a great interest in artificial systems able to understand and recognize human emotions. In this paper an Emotion Recognition System based on classical neural networks and neuro-fuzzy classifiers is proposed. Emotion recognition is performed in real time starting from a video stream acquired by a common webcam monitoring the user's face. Neurofuzzy classifiers, in comparison with Multi Layer Perceptron trained by EBP algorithm, show very short training times, allowing applications with easy and automated set up procedures, to be used in a wide range of applications, from entertainment to safety. The algorithm yields very interesting performances and can be adopted to recognize emotions as well as possible pathological conditions of the individual to be monitored.

[1]  S. Tanaka,et al.  Feasibility study on driver's stress detection from differential skin temperature measurement , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Marc Garbey,et al.  Contact-Free Measurement of Cardiac Pulse Based on the Analysis of Thermal Imagery , 2007, IEEE Transactions on Biomedical Engineering.

[3]  R. Lazarus.  Relational meaning and discrete emotions. , 2001 .

[4]  Ioannis T. Pavlidis,et al.  StressCam: non-contact measurement of users' emotional states through thermal imaging , 2005, CHI Extended Abstracts.

[5]  Ioannis T. Pavlidis,et al.  The Segmentation of the Supraorbital Vessels in Thermal Imagery , 2008, 2008 IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance.

[6]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[7]  John D. Lee,et al.  Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[8]  Jolieke Mesken,et al.  Determinants and consequences of drivers' emotions , 2006 .

[9]  A. Fascioli,et al.  Pedestrian Protection Systems : Issues , Survey , and Challenges , 2007 .

[10]  Sanjay V. Dudul,et al.  Neural Network Classifier for Human Emotion Recognition from Facial Expressions Using Discrete Cosine Transform , 2008, 2008 First International Conference on Emerging Trends in Engineering and Technology.

[11]  Stefan K. Gehrig,et al.  Collision Avoidance for Vehicle-Following Systems , 2007, IEEE Transactions on Intelligent Transportation Systems.

[12]  Klaus C. J. Dietmayer,et al.  Situation Assessment of an Autonomous Emergency Brake for Arbitrary Vehicle-to-Vehicle Collision Scenarios , 2009, IEEE Transactions on Intelligent Transportation Systems.

[13]  Antonello Rizzi,et al.  Adaptive resolution min-max classifiers , 2002, IEEE Trans. Neural Networks.

[14]  F. Hara,et al.  Facial interaction between animated 3D face robot and human beings , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[15]  Siu-Yeung Cho,et al.  Adaptive Processing of Face Emotion Tree Structures , 2006, 18th International Conference on Pattern Recognition (ICPR'06).