Real-time emotion recognition from facial images using Raspberry Pi II

In present day technology human-machine interaction is growing in demand and machine needs to understand human gestures and emotions. If a machine can identify human emotions, it can understand human behavior better, thus improving the task efficiency. Emotions can understand by text, vocal, verbal and facial expressions. Facial expressions play big role in judging emotions of a person. It is found that limited work is done in field of real time emotion recognition using facial images. In this paper, we propose a method for real time emotion recognition from facial image. In the proposed method we use three steps face detection using Haar cascade, features extraction using Active shape Model(ASM), (26 facial points extracted) and Adaboost classifier for classification of five emotions anger, disgust, happiness, neutral and surprise. The novelty of our proposed method lies in the implementation of emotion recognition at real time on Raspberry Pi II and an average accuracy of 94% is achieved at real time. The Raspberry Pi II when mounted on a mobile robot can recognize emotions dynamically in real time under social/service environments where emotion recognition plays a major role.

[1]  S. Demleitner [Communication without words]. , 1997, Pflege aktuell.

[2]  Rohit Verma,et al.  Fast facial expression recognition based on local binary patterns , 2013, 2013 26th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE).

[3]  Pablo Bustos,et al.  A real time and robust facial expression recognition and imitation approach for affective human-robot interaction using Gabor filtering , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Kamlesh Mistry,et al.  Intelligent Appearance and shape based facial emotion recognition for a humanoid robot , 2014, The 8th International Conference on Software, Knowledge, Information Management and Applications (SKIMA 2014).

[5]  Zhou Yu,et al.  Real-time Facial Expression Recognition Based on Adaptive Canny Operator Edge Detection , 2010, 2010 Second International Conference on Multimedia and Information Technology.

[6]  B. Prabhakaran,et al.  Real-Time Mobile Facial Expression Recognition System -- A Case Study , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Maja Pantic,et al.  Fully Automatic Recognition of the Temporal Phases of Facial Actions , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Alain Pruski,et al.  Human-Computer Interaction Using Emotion Recognition from Facial Expression , 2011, 2011 UKSim 5th European Symposium on Computer Modeling and Simulation.

[9]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.