Analysis on Temporal Sparsity of Human Face for Various Emotion Stimuli

Recently, many researchers have been focused on partial region of single frame image such as mouth, eyes in order to recognize facial expression. However, according to the recent psychological theory, the other regions of face included important factors in terms of facial expression. To solve the problem of previous works, our proposed method verifies facial temporal movement in the face region. For that, one hundred regions (10×10) are defined onto the detected face region. In addition, temporal sparsity of each region was calculated on specific frequency band well known to express micro-movement of human body. To perform the calculation, adjacent frame subtraction method was used. Consequently, sparsity data against four emotion stimuli was obtained. At result, we confirmed that spatial characteristics of temporal sparsity were different accordance with different emotions.

[1]  Hong Yang,et al.  A LBP-based Face Recognition Method with Hamming Distance Constraint , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[2]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[3]  Tomaso A. Poggio,et al.  Face recognition with support vector machines: global versus component-based approach , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[4]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[5]  Maja Pantic,et al.  The SEMAINE corpus of emotionally coloured character interactions , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[6]  Wang Xiaotong,et al.  Neighborhood Limited Empirical Mode Decomposition and Application in Image Processing , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[7]  Min Cheol Whang,et al.  Vision Based Body Dither Measurement for Estimating Human Emotion Parameters , 2013, HCI.