Eyes Alive Eyes Alive Eyes Alive Figure 1: Sample Images of an Animated Face with Eye Movements

For an animated human face model to appear natural it should produce eye movements consistent with human ocular behavior. During face-to-face conversational interactions, eyes exhibit conversational turntaking and agent thought processes through gaze direction, saccades, and scan patterns. We have implemented an eye movement model based on empirical models of saccades and statistical models of eye-tracking data. Face animations using stationary eyes, eyes with random saccades only, and eyes with statistically derived saccades are compared, to evaluate whether they appear natural and effective while communicating.

[1]  M. Argyle,et al.  EYE-CONTACT, DISTANCE AND AFFILIATION. , 1965, Sociometry.

[2]  George Wood Beeler,et al.  Stochastic processes in the human eye movement control system , 1965 .

[3]  A. Kendon.  Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[4]  S. Duncan,et al.  Some Signals and Rules for Taking Speaking Turns in Conversations , 1972 .

[5]  E. Bizzi,et al.  Central programming and peripheral feedback during eye-head coordination in monkeys. , 1972, Bibliotheca ophthalmologica : supplementa ad ophthalmologica.

[6]  T. Warabi,et al.  The reaction time of eye-head coordination in man , 1977, Neuroscience Letters.

[7]  Norman I. Badler,et al.  Animating facial expressions , 1981, SIGGRAPH '81.

[8]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  L. Vistnes.  The Artist??s Complete Guide to Facial Expression , 1992 .

[10]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[11]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[12]  Alex Pentland,et al.  Facial expression recognition using a dynamic model and motion energy , 1995, Proceedings of IEEE International Conference on Computer Vision.

[13]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[14]  Mark Steedman,et al.  Generating Facial Expressions for Speech , 1996, Cogn. Sci..

[15]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[16]  Matthew Stone,et al.  An anthropometric face model using variational techniques , 1998, SIGGRAPH.

[17]  Henrique S. Malvar,et al.  Making Faces , 2019, Topoi.

[18]  J. Cassell,et al.  Turn taking vs. Discourse Structure: How Best to Model Multimodal Conversation , 1998 .

[19]  Matthew Brand,et al.  Voice puppetry , 1999, SIGGRAPH.

[20]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[21]  Roel Vertegaal,et al.  Effects of Gaze on Multiparty Mediated Communication , 2000, Graphics Interface.

[22]  Anton Nijholt,et al.  Why conversational agents should catch the eye , 2000, CHI Extended Abstracts.

[23]  N. Shimizu.  [Neurology of eye movements]. , 2000, Rinsho shinkeigaku = Clinical neurology.

[24]  Anton Nijholt,et al.  Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes , 2001, CHI.

[25]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.