Animation realism affects perceived character appeal of a self-virtual face

Appearance and animation realism of virtual characters in games, movies or other VR applications has been shown to affect audiences levels of acceptance and engagement with these characters. However, when a virtual character is representing us in VR setup, the level of engagement might also depend on the levels of perceived ownership and sense of control (agency) we feel towards this virtual character. In this study, we used advanced face-tracking technology in order to map real-time tracking data of participants' head and eye movements, as well as facial expressions on virtual faces with different appearance realism characteristics (realistic or cartoon-like) and different levels of animation realism (complete or reduced facial movements). Our results suggest that virtual faces are perceived as more appealing when higher levels of animation realism are provided through real-time tracking. Moreover, high-levels of face-ownership and agency can be induced through synchronous mapping of the face tracking on the virtual face. In this study, we provide valuable insights for future games that use face tracking as an input.

[1]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.

[2]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[3]  V. Ramachandran,et al.  Projecting sensations to external objects: evidence from skin conductance response , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[4]  N. Brady,et al.  My left brain and me: a dissociation in the perception of self and others , 2004, Neuropsychologia.

[5]  N. Brady,et al.  Perceptual asymmetries are preserved in memory for highly familiar faces of self and friend , 2005, Brain and Cognition.

[6]  Jun'ichiro Seyama,et al.  The Uncanny Valley: Effect of Realism on the Impression of Artificial Human Faces , 2007, PRESENCE: Teleoperators and Virtual Environments.

[7]  Heloir,et al.  The Uncanny Valley , 2019, The Animation Studies Reader.

[8]  Tom Geller,et al.  Overcoming the Uncanny Valley , 2008, IEEE Computer Graphics and Applications.

[9]  M. Tsakiris.  Looking for Myself: Current Multisensory Input Alters Self-Face Recognition , 2008, PloS one.

[10]  Justin M. Harris,et al.  If I Were You: Perceptual Illusion of Body Swapping , 2008, PloS one.

[11]  Maria V. Sanchez-Vives,et al.  Inducing Illusory Ownership of a Virtual Body , 2009, Front. Neurosci..

[12]  Maria V. Sanchez-Vives,et al.  First Person Experience of Body Transfer in Virtual Reality , 2010, PloS one.

[13]  Jessica K. Hodgins,et al.  The saliency of anomalies in animated human characters , 2010, TAP.

[14]  H. Bülthoff,et al.  Render me real?: investigating the effect of render style on the perception of animated virtual humans , 2012, ACM Trans. Graph..

[15]  Ludovic Hoyet,et al.  Evaluating the effect of emotion on gender recognition in virtual humans , 2013, SAP.

[16]  Jessica K. Hodgins,et al.  Perceptual effects of damped and exaggerated facial motion in animated characters , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[17]  M. Slater,et al.  The building blocks of the full body ownership illusion , 2013, Front. Hum. Neurosci..

[18]  M. Slater,et al.  Measuring the Effects through Time of the Influence of Visuomotor and Visuotactile Synchronous Stimulation on a Virtual Body Ownership Illusion , 2014, Perception.