Emotional facial expression interface: effects of displayed facial designs

In supporting the visual-mediated emotional recognition, little research has centred on analysing the effect of presenting different combinatorial facial designs. Moreover, in the theoretical field of emotions, research on the recognition of emotional facial expressions (EFE) is mainly based on static and posed databases tested in unnatural contexts (explicit recognition task of an emotion). Our research has constructed and validated a database, DynEmo, with dynamic and spontaneous emotional facial expressions. So different facial interface designs (whole face, zoomed face, eyes + mouth, whole face + mouth, whole face + eyes, etc., n = 11) are experimentally compared to find their impact in terms of emotional recognition. The results show the facial interface design relevance in terms of emotional recognition. The application of this work is transferable to facial interfaces useful for video-mediated interaction.

[1]  J. N. Bassili.  Facial motion in the perception of faces and of emotional expression. , 1978, Journal of experimental psychology. Human perception and performance.

[2]  D. Rutter,et al.  The role of visual communication in synchronising conversation , 1977 .

[3]  P. Ekman.  Pictures of Facial Affect , 1976 .

[4]  G. Kirouac,et al.  EXPRESSIONS FACIALES EMOTIONNELLES SPONTANEES DYNAMIQUES ET STATIQUES: COMPARAISON D'ETUDES DE JUGEMENT CATEGORIEL ET DIMENSIONNEL , 1995 .

[5]  J. Fernández-Dols,et al.  Are Spontaneous Expressions and Emotions Linked? an Experimental Test of Coherence , 1997 .

[6]  Steve Whittaker,et al.  Conversations Over Video Conferences: An Evaluation of the Spoken Aspects of Video-Mediated Communication , 1993, Hum. Comput. Interact..

[7]  Pierre Dillenbourg,et al.  Reducing cognitive load in learning from animation: impact of delivery features , 2003 .

[8]  Nadine Mandran,et al.  DYNEMO: A Corpus of dynamic and spontaneous emotional facial expressions , 2010 .

[9]  Anne H. Anderson,et al.  Video data and video links in mediated communication: what do users value? , 2000, Int. J. Hum. Comput. Stud..

[10]  J. Russell.  Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. , 1994, Psychological bulletin.

[11]  J. N. Bassili.  Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. , 1979, Journal of personality and social psychology.

[12]  A. Manstead,et al.  The social and emotional functions of facial displays , 1999 .

[13]  P. Chandler,et al.  Why Some Material Is Difficult to Learn , 1994 .

[14]  M. T. Motley,et al.  Facial expression of emotion: A comparison of posed expressions versus spontaneous expressions in an interpersonal communication setting , 1988 .

[15]  John Short,et al.  The social psychology of telecommunications , 1976 .

[16]  R. Mayer,et al.  The instructive animation: helping students build connections between words and pictures in multimedia learning , 1992 .

[17]  Vicki Bruce,et al.  Dynamic properties influence the perception of facial , 2001 .

[18]  K. Scherer,et al.  Cues and channels in emotion recognition. , 1986 .

[19]  La compréhension des documents complexes , 2008, Ergonomie des documents électroniques.

[20]  Christian Heath,et al.  Disembodied conduct: communication through video in a multi-media office environment , 1991, CHI.

[21]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[22]  A. Tcherkassof,et al.  Facial expressions of emotions: A methodological contribution to the study of spontaneous and dynamic emotional faces , 2007 .

[23]  Michel Dubois,et al.  Seeing the Face and Observing the Actions: The Effects of Nonverbal Cues on Mediated Tutoring Dialogue , 2008, Intelligent Tutoring Systems.

[24]  Gwyneth Doherty-Sneddon,et al.  Comparison of Face-to-Face and Video-Mediated Interaction , 1996, Interact. Comput..

[25]  Timothy R. Jordan,et al.  The recognition of mental states from dynamic and static facial expressions , 2009 .

[26]  J. Russell.  The psychology of facial expression: Reading emotions from and into faces: Resurrecting a dimensional-contextual perspective , 1997 .

[27]  U. Hess,et al.  Differentiating emotion elicited and deliberate emotional facial expressions , 1990 .

[28]  Michel Dubois,et al.  The impact of nonverbal cues on mediated tutoring interaction: an experimental study , 2009 .