Measurement of distal EMG signals using a wearable device for reading facial expressions

In this paper we present a quantitative analysis of electrode positions on the side of the face for facial expression recognition using facial bioelectrical signals. We show that distal electrode locations on areas of low facial mobility have a strong amplitude and are correlated to signals captured in the traditional positions on top of the facial muscles. We report on electrode position choice as well successful facial expression identification using computational methods. We also propose a wearable interface device that can detect facial bioelectrical signals distally in a continuous manner while being unobtrusive to the user. The proposed device can be worn on the side of the face and capture signals that are considered to be a mixture of facial electromyographic signals and other bioelectrical signals. Finally we show the design of an interface that can be comfortably worn by the user and makes facial expression recognition possible.

[1]  A. J. Fridlund,et al.  Guidelines for human electromyographic research. , 1986, Psychophysiology.

[2]  Ralph Gross,et al.  Quo vadis Face Recognition , 2001 .

[3]  W. Marsden I and J , 2012 .

[4]  Veikko Surakka,et al.  Real-time estimation of emotional experiences from facial expressions , 2006, Interact. Comput..

[5]  Rana El Kaliouby,et al.  Self-Cam: feedback from what would be your social partner , 2006, SIGGRAPH '06.

[6]  Kenji Suzuki,et al.  Robot Assisted Smile Recovery , 2010 .

[7]  P. Ekman,et al.  Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. , 1994, Psychological bulletin.

[8]  W. Sato,et al.  Spontaneous facial mimicry in response to dynamic facial expressions , 2005, Cognition.

[9]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[10]  Nicu Sebe,et al.  Facial expression recognition from video sequences: temporal and static modeling , 2003, Comput. Vis. Image Underst..

[11]  Rosalind W. Picard,et al.  Expression glasses: a wearable device for facial expression recognition , 1999, CHI Extended Abstracts.

[12]  P. Ekman What emotion categories or dimensions can observers judge from facial behavior , 1982 .

[13]  J. Russell,et al.  The psychology of facial expression: Studies in Emotion and Social Interaction , 1997 .

[14]  Cheng-Ning Huang,et al.  The Review of Applications and Measurements in Facial Electromyography , 2004 .

[15]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[16]  J. Hietanen,et al.  Facial and emotional reactions to Duchenne and non-Duchenne smiles. , 1998, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[17]  Gwen Littlewort,et al.  Toward Practical Smile Detection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.