Unpleasantness of animated characters corresponds to increased viewer attention to faces

Animated characters are frequently used in television programs, movies, and video games, but relatively little is known about how their characteristics affect attention and viewer opinions. We used eyetracking and questionnaires to examine the role of visual complexity and animation style on viewing patterns and ratings of video-recorded and animated movie clips. We created videos of an actress performing and describing a series of actions with blocks. Of the videos, one set included regular HD recordings of the actress. The remaining video sets were animated using motion capture data from that actress for three characters: realistic, cartoon, and robot. Increased facial looking time correlated with unpleasantness ratings for individual characters and clips, determining that animation styles have an effect on both viewing patterns and audience members' subjective opinions of characters. In addition, the method described in this paper can expand future research on character animation.

[1]  N. Mackworth,et al.  Cognitive determinants of fixation location during picture viewing. , 1978, Journal of experimental psychology. Human perception and performance.

[2]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[3]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.

[4]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[5]  Hironobu Sakaguchi,et al.  Final Fantasy - The Spirits Within , 2001, SIGGRAPH 2001.

[6]  Andrew Olney,et al.  Upending the Uncanny Valley , 2005, AAAI.

[7]  J. Hyönä,et al.  Eye movement assessment of selective attentional capture by emotional pictures. , 2006, Emotion.

[8]  Mark W. Becker,et al.  Object-intrinsic oddities draw early saccades. , 2007, Journal of experimental psychology. Human perception and performance.

[9]  Jun'ichiro Seyama,et al.  The Uncanny Valley: Effect of Realism on the Impression of Artificial Human Faces , 2007, PRESENCE: Teleoperators and Virtual Environments.

[10]  Heloir,et al.  The Uncanny Valley , 2019, The Animation Studies Reader.

[11]  Christof Koch,et al.  Predicting human gaze using low-level saliency combined with face detection , 2007, NIPS.

[12]  Yifan Wang,et al.  Exploring the Uncanny Valley with Japanese Video Game Characters , 2007, DiGRA Conference.

[13]  Karl F. MacDorman,et al.  Sensitivity to the proportions of faces that vary in human likeness , 2008, Comput. Hum. Behav..

[14]  Sophie Jörg,et al.  Investigating the role of body shape on the perception of emotion , 2009, TAP.

[15]  K. Rayner,et al.  Eye movements when looking at unusual/weird scenes: are there cultural differences? , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[16]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[17]  Karl F. MacDorman,et al.  Too real for comfort? Uncanny responses to computer generated faces , 2009, Comput. Hum. Behav..

[18]  A. Kingstone,et al.  Saliency does not account for fixations to eyes within social scenes , 2009, Vision Research.

[19]  Jessica K. Hodgins,et al.  The saliency of anomalies in animated human characters , 2010, TAP.

[20]  Vincent D Costa,et al.  Scan patterns when viewing natural scenes: emotion, complexity, and repetition. , 2011, Psychophysiology.

[21]  Sophie Jörg,et al.  Perception of Body and Hand Animations for Realistic Virtual Characters , 2011 .

[22]  H. Bülthoff,et al.  Render me real?: investigating the effect of render style on the perception of animated virtual humans , 2012, ACM Trans. Graph..

[23]  Heinrich H. Bülthoff,et al.  Render me real? , 2012, ACM Trans. Graph..

[24]  Yaqing Niu,et al.  Visual and emotional salience influence eye movements , 2012, TAP.