Thermal Analysis of Facial Muscles Contractions

Facial expressions can be systematically coded using the Facial Action Coding System (FACS) that describes the specific action unit (AU) or combination of AUs elicited during different kinds of expressions. This study investigated the thermal patterns concomitant to specific action units performance. As thermal imaging can track dynamic patterns in facial temperature at any distance (>; 0.4 m), with high temporal (<; 20 m) and thermal (<; 20 mK@300 K) resolutions, this noninvasive technique was tested as a method to assess fluctuations of facial heat patterns induced by facial muscles contractions. Four FACS-trained coders produced nine different AUs or combination of AUs at various speeds and intensities. Using a spatial pattern approach based on PCA decomposition of the thermal signal, we showed that thermal fluctuations are specific to the activated AUs and are sensitive to the kinetics and intensities of AU production. These results open new avenues for studying patterns of facial muscle activity related to emotion or other cognitively induced activities, in a noninvasive manner, avoiding potential lighting issues.

[1]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[2]  Ioannis T. Pavlidis,et al.  Tracking human breath in infrared imaging , 2005, Fifth IEEE Symposium on Bioinformatics and Bioengineering (BIBE'05).

[3]  Andrew R. Webb,et al.  Statistical Pattern Recognition , 1999 .

[4]  Shunji Goto,et al.  Decrease in nasal temperature of rhesus monkeys (Macaca mulatta) in negative emotional state , 2005, Physiology & Behavior.

[5]  Maja Pantic,et al.  Facial Expression Recognition , 2009, Encyclopedia of Biometrics.

[6]  Marc Garbey,et al.  Harvesting the Thermal Cardiac Pulse Signal , 2006, MICCAI.

[7]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[8]  Ioannis T. Pavlidis,et al.  StressCam: non-contact measurement of users' emotional states through thermal imaging , 2005, CHI Extended Abstracts.

[9]  Ioannis T. Pavlidis,et al.  Thermal image analysis for anxiety detection , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[10]  K. Scherer,et al.  Sequential unfolding of novelty and pleasantness appraisals of odors: evidence from facial electromyography and autonomic reactions. , 2009, Emotion.

[11]  Hideto Ide,et al.  Emotion Analysis using FST , 1998, J. Robotics Mechatronics.

[12]  J Bangsbo,et al.  Heat production in human skeletal muscle at the onset of intense dynamic exercise , 2000, The Journal of physiology.

[13]  Melody Y. Kiang,et al.  A comparative assessment of classification methods , 2003, Decis. Support Syst..

[14]  Pascal Carrive,et al.  Changes in cutaneous and body temperature during and after conditioned fear to context in the rat , 2005, The European journal of neuroscience.

[15]  Takeo Kanade,et al.  Detection, tracking, and classification of action units in facial expression , 2000, Robotics Auton. Syst..