Adaptive system to learn and recognize emotional state of mind

Facial expression is the most natural way for the humans to convey their emotions with intensions. Facial expressions can be easily detected by human but for machines, it is very challenging task. In this paper, an approach for real time emotion detection is presented using real time graphic user interface for detection of emotion through a web camera. The proposed system named as Adaptive System For Recognizing State Of Mind (ASFRSOM) system is designed using the three major components: face detection, feature extraction and classification. For facial feature extraction, local binary pattern is used and the extracted features are applied to support vector machine for emotion recognition. The approach proposed in the presented work is evaluated on extended Cohn Kanade database and results in 79% accuracy. To further prove the accuracy of the proposed approach, it is used on 15 subjects in real time and emotions were accurately detected.

[1]  Tsutomu Miyasato,et al.  Emotion recognition from audiovisual information , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).

[2]  Lawrence S. Chen,et al.  Joint processing of audio-visual information for the recognition of emotional expressions in human-computer interaction , 2000 .

[3]  M. Yachida,et al.  Facial expression recognition and its degree estimation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  M. Pietikäinen,et al.  Facial Expression Recognition with Local Binary Patterns and Linear Programming 1 , 2005 .

[5]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[6]  P. Ekman,et al.  Smiles when lying. , 1988, Journal of personality and social psychology.

[7]  Larry S. Davis,et al.  Recognizing Human Facial Expressions From Long Image Sequences Using Optical Flow , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Ioannis Pitas,et al.  Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines , 2007, IEEE Transactions on Image Processing.

[9]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[10]  S. Lajevardi,et al.  Facial expression recognition from image sequences using optimized feature selection , 2008, 2008 23rd International Conference Image and Vision Computing New Zealand.

[11]  L. de Silva,et al.  Facial emotion recognition using multi-modal information , 1997, Proceedings of ICICS, 1997 International Conference on Information, Communications and Signal Processing. Theme: Trends in Information Systems Engineering and Wireless Multimedia Communications (Cat..

[12]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[13]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  J. Cacioppo,et al.  Inferring psychological significance from physiological signals. , 1990, The American psychologist.