Repeatability of facial electromyography (EMG) activity over corrugator supercilii and zygomaticus major on differentiating various emotions

Recent affective computing findings indicated that effectively identifying users’ emotional responses is an important issue to improve the quality of ambient intelligence. In the current study, two bipolar facial electromyography (EMG) channels over corrugator supercilii and zygomaticus major were employed for differentiating various emotional states in two dimensions of valence (negative, neutral and positive) and arousal (high and low) while participants looked at affective visual stimuli. The results demonstrated that corrugator EMG and zygomaticus EMG efficiently differentiated negative and positive emotions from others, respectively. Moreover, corrugator EMG discriminated emotions on valence clearly, whereas zygomaticus EMG was ambiguous in neutral and negative emotional states. However, there was no significant statistical evidence for the discrimination of facial EMG responses in the dimension of arousal. Furthermore, correlation analysis proved significant correlations between facial EMG activities and ratings of valence performed by participants and other samples, which strongly supported the consistency of facial EMG reactions and subjective emotional experiences. In addition, the repeatability of facial EMG indicated by intraclass correlation coefficient (ICC) were provided, in which corrugator EMG held an excellent level of repeatability, and zygomaticus EMG grasped only a poor level of repeatability. Considering these results, facial EMG is reliable and effective to identify negative and positive emotional experiences elicited by affective visual stimuli, which may offer us an alternative method in building a basis for automated classification of users’ affective states in various situations.

[1]  Flávia Teixeira-Silva,et al.  The anxiogenic video-recorded Stroop Color–Word Test: psychological and physiological alterations and effects of diazepam , 2004, Physiology & Behavior.

[2]  J. Cacioppo,et al.  Electromyographic activity over facial muscle regions can differentiate the valence and intensity of affective reactions. , 1986, Journal of personality and social psychology.

[3]  Anton van Boxtel,et al.  Facial EMG as a tool for inferring affective states , 2010 .

[4]  A. J. Fridlund,et al.  Guidelines for human electromyographic research. , 1986, Psychophysiology.

[5]  Matthew E. Wolak,et al.  Guidelines for estimating repeatability , 2012 .

[6]  J. Cacioppo,et al.  The skeletomotor system: Surface electromyography. , 2007 .

[7]  M. Bradley,et al.  Emotion, attention, and the startle reflex. , 1990, Psychological review.

[8]  L. Anolli The hidden structure of interaction : from neurons to culture patterns , 2005 .

[9]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[10]  W. Sato,et al.  Enhanced facial EMG activity in response to dynamic facial expressions. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  J. Cacioppo,et al.  Electromyograms as measures of extent and affectivity of information processing. , 1981, The American psychologist.

[12]  P. Ekman,et al.  Facial signs of emotional experience. , 1980 .

[13]  J. Cacioppo,et al.  Relationship between attitudes and evaluative space: A critical review, with emphasis on the separability of positive and negative substrates. , 1994 .

[14]  Matthias Schmid,et al.  Applying additive modelling and gradient boosting to assess the effects of watershed and reach characteristics on riverine assemblages , 2012 .

[15]  M. Bradley,et al.  The International Affective Picture System (IAPS) in the study of emotion and attention. , 2007 .

[16]  Roberto Merletti,et al.  Repeatability of surface EMG variables in the sternocleidomastoid and anterior scalene muscles , 2002, European Journal of Applied Physiology.

[17]  W. Davis,et al.  Properties of human affect induced by static color slides (IAPS): dimensional, categorical and electromyographic analysis , 1995, Biological Psychology.

[18]  R Merletti,et al.  Repeatability of surface EMG variables during voluntary isometric contractions of the biceps brachii muscle. , 1999, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[19]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .

[20]  A. Mehrabian Framework for a comprehensive description and measurement of emotional states. , 1995, Genetic, social, and general psychology monographs.

[21]  U Dimberg,et al.  Facial electromyography and emotional reactions. , 1990, Psychophysiology.

[22]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.

[23]  J. Larsen,et al.  A facial electromyographic investigation of affective contrast. , 2009, Psychophysiology.

[24]  J. Cacioppo,et al.  Electromyographic activity over facial muscle regions can differentiate the valence and intensity of affective reactions. , 1986, Journal of personality and social psychology.

[25]  Jeff T. Larsen,et al.  Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii. , 2003, Psychophysiology.

[26]  M. Bradley,et al.  Picture media and emotion: effects of a sustained affective context. , 1996, Psychophysiology.

[27]  Maital Neta,et al.  Corrugator muscle responses are associated with individual differences in positivity-negativity bias. , 2009, Emotion.

[28]  C. Forster,et al.  Postural and dynamic masseter and anterior temporalis muscle EMG repeatability in serial assessments. , 2009, Journal of oral rehabilitation.

[29]  Charalampos Bratsas,et al.  On the Classification of Emotional Biosignals Evoked While Viewing Affective Pictures: An Integrated Data-Mining-Based Approach for Healthcare Applications , 2010, IEEE Transactions on Information Technology in Biomedicine.

[30]  J. Cacioppo,et al.  Handbook Of Psychophysiology , 2019 .

[31]  D BamidisPanagiotis,et al.  On the classification of emotional biosignals evoked while viewing affective pictures , 2010 .

[32]  Darin A Padua,et al.  Repeatability of surface EMG during gait in children. , 2005, Gait & posture.

[33]  U. Dimberg For Distinguished Early Career Contribution to Psychophysiology: Award Address, 1988 , 1990 .

[34]  F. Schwab,et al.  Viewers Viewed : Facial Expression Patterns while Watching TV News , 2005 .

[35]  Michael D. Robinson,et al.  Measures of emotion: A review , 2009, Cognition & emotion.

[36]  Harald C. Traue,et al.  The influence of neuroticism and psychological symptoms on the assessment of images in three-dimensional emotion space , 2011, Psycho-social medicine.