Discriminating real and posed smiles: human and avatar smiles

This study addresses the question whether untrained and unaided observers can discriminate between real and posed smiles from different sets of smiling videos. Observers were shown smiling face videos, either in single or paired, to rate each of them on a number of scales intended to assess perceived real and posed smiles. We implemented four experiments where single smiles were shown in most cases, and paired smiles were shown in the third experiment. We found that observers are more accurate in response to paired videos (72.9%) compared to single videos (61.7% and 60.2%). Performance is increased when voting is introduced, but we need 11 to 13 observers in single smiles and 13 to 15 in paired smile discrimination. We found that female observers are more accurate compared to male observers. On testing with 8 'smiling' virtual avatars we found only one was rated a real smile. This work will have significant impact on judgement of genuineness of smiles from avatars / automated virtual assistants, in that untrained individuals using normal human abilities can estimate how real the virtual smiles will seem for the human users to whom they are directed.

[1]  Tamás D. Gedeon,et al.  "Moving to the centre": A gaze-driven remote camera control for teleoperation , 2011, Interact. Comput..

[2]  Albert Ali Salah,et al.  Are You Really Smiling at Me? Spontaneous versus Posed Enjoyment Smiles , 2012, ECCV.

[3]  Mike Seymour,et al.  Meet Mike: epic avatars , 2017, SIGGRAPH VR Village.

[4]  Maja Pantic,et al.  Web-based database for facial expression analysis , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[5]  P. Gosselin,et al.  Children's and Adults' Knowledge of the Distinction Between Enjoyment and Nonenjoyment Smiles , 2002 .

[6]  Zhihong Zeng,et al.  Bimodal HCI-related affect recognition , 2004, ICMI '04.

[7]  Tamás D. Gedeon,et al.  Classifying posed and real smiles from observers' peripheral physiology , 2017, PervasiveHealth.

[8]  Mohammad Soleymani,et al.  A Multimodal Database for Affect Recognition and Implicit Tagging , 2012, IEEE Transactions on Affective Computing.

[9]  Tamás D. Gedeon,et al.  Are you really angry?: detecting emotion veracity as a proposed tool for interaction , 2017, OZCHI.

[10]  Mario Del Líbano,et al.  What makes a smiling face look happy? Visual saliency, distinctiveness, and affect , 2018, Psychological research.

[11]  Maja Pantic,et al.  The MAHNOB Laughter database , 2013, Image Vis. Comput..

[12]  Tamás D. Gedeon,et al.  Emotion Recognition In The Wild Challenge 2014: Baseline, Data and Protocol , 2014, ICMI.

[13]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[14]  Jeremy N. Bailenson,et al.  The Effect of Behavioral Realism and Form Realism of Real-Time Avatar Faces on Verbal Disclosure, Nonverbal Disclosure, Emotion Recognition, and Copresence in Dyadic Interaction , 2006, PRESENCE: Teleoperators and Virtual Environments.

[15]  S. Gunnery,et al.  Perceptions of Duchenne and non-Duchenne smiles: A meta-analysis , 2016, Cognition & emotion.

[16]  Jisu Park.  The Effect of Character's Visual Style on Viewer's Aempathy and Sympathy Responses , 2017 .

[17]  Md. Zakir Hossain,et al.  Observer's Galvanic Skin Response for Discriminating Real from Fake Smiles , 2016, ACIS.

[18]  M. Del Giudice,et al.  Differences between children and adults in the recognition of enjoyment smiles. , 2007, Developmental psychology.

[19]  Pupillary Responses of Asian Observers in Discriminating Real from Fake Smiles: a Preliminary Study , 2016 .

[20]  Tamás D. Gedeon,et al.  Learning-based Face Synthesis for Pose-Robust Recognition from Single Image , 2009, BMVC.

[21]  P. Ekman,et al.  Behavioral Markers and Recognizability of the Smile of Enjoyment , 1993 .

[22]  C. Macrae,et al.  Why are you smiling at me? Social functions of enjoyment and non-enjoyment smiles. , 2010, The British journal of social psychology.

[23]  Christine L. Lisetti,et al.  A social informatics approach to human-robot interaction with a service social robot , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).