On emotion recognition of faces and of speech using neural networks, fuzzy logic and the ASSESS system

We propose a framework for the processing of face image sequences and speech, using different dynamic techniques to extract appropriate features for emotion recognition. The features will be used by a hybrid classification procedure, employing neural network techniques and fuzzy logic, to accumulate the evidence for the presence of an emotional expression of the face and the speaker's voice.

[1]  Roddy Cowie,et al.  Automatic statistical analysis of the signal and prosodic signs of emotion in speech , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[2]  Frank Dellaert,et al.  Recognizing emotion in speech , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[3]  K. Scherer,et al.  Acoustic profiles in vocal emotion expression. , 1996, Journal of personality and social psychology.

[4]  Alex Pentland,et al.  LAFTER: Lips and Face Real Time Tracker with Facial Expression Recognition , 1997, CVPR 1997.

[5]  Alexander H. Waibel,et al.  Real-Time Face and Facial Feature Tracking and Applications , 1998, AVSP.

[6]  Roddy Cowie,et al.  What a neural net needs to know about emotion words , 1999 .

[7]  K. Karpouzis,et al.  Emotion Recognition Using Feature Extraction and 3-D Models , 1999 .

[8]  Valery A. Petrushin,et al.  EMOTION IN SPEECH: RECOGNITION AND APPLICATION TO CALL CENTERS , 1999 .

[9]  N. Tsapatsoulis,et al.  Comparing Template-based , Feature-based and Supervised Classification of Facial Expressions from Static Images , 1999 .

[10]  B. Apolloni,et al.  A general framework for symbol and rule extraction in neural networks , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[11]  Nicolas Tsapatsoulis,et al.  Exploring the time course of facial expressions with a fuzzy system , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[12]  A. Murat Tekalp,et al.  Face and 2-D mesh animation in MPEG-4 , 2000, Signal Process. Image Commun..

[13]  F. Piat,et al.  Refining Rules of Emotion Recognition in Hybrid Systems , 2022 .