Eyes alive

For an animated human face model to appear natural it should produce eye movements consistent with human ocular behavior. During face-to-face conversational interactions, eyes exhibit conversational turn-taking and agent thought processes through gaze direction, saccades, and scan patterns. We have implemented an eye movement model based on empirical models of saccades and statistical models of eye-tracking data. Face animations using stationary eyes, eyes with random saccades only, and eyes with statistically derived saccades are compared, to evaluate whether they appear natural and effective while communicating.

[1]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[2]  Frederic I. Parke,et al.  A parametric model for human faces. , 1974 .

[3]  Norman I. Badler,et al.  Animating facial expressions , 1981, SIGGRAPH '81.

[4]  George Wood Beeler,et al.  Stochastic processes in the human eye movement control system , 1965 .

[5]  Anton Nijholt,et al.  Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes , 2001, CHI.

[6]  V. Laxon,et al.  The conservation of number, mother, water and a fried egg chez l'enfant. , 1970, Acta psychologica.

[7]  Roel Vertegaal,et al.  Effects of Gaze on Multiparty Mediated Communication , 2000, Graphics Interface.

[8]  Mark Steedman,et al.  Generating Facial Expressions for Speech , 1996, Cogn. Sci..

[9]  N. Shimizu.  [Neurology of eye movements]. , 2000, Rinsho shinkeigaku = Clinical neurology.

[10]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[11]  M. Argyle,et al.  EYE-CONTACT, DISTANCE AND AFFILIATION. , 1965, Sociometry.

[12]  Henrique S. Malvar,et al.  Making Faces , 2019, Topoi.

[13]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[14]  Norman I. Badler,et al.  Where to Look? Automating Attending Behaviors of Virtual Human Characters , 1999, Agents.

[15]  E. Bizzi,et al.  Central programming and peripheral feedback during eye-head coordination in monkeys. , 1972, Bibliotheca ophthalmologica : supplementa ad ophthalmologica.

[16]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[17]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[18]  S. Duncan,et al.  Some Signals and Rules for Taking Speaking Turns in Conversations , 1972 .

[19]  L. Vistnes.  The Artist??s Complete Guide to Facial Expression , 1992 .

[20]  Matthew Brand,et al.  Voice puppetry , 1999, SIGGRAPH.

[21]  L. Stark,et al.  Most naturally occurring human saccades have magnitudes of 15 degrees or less. , 1975, Investigative ophthalmology.

[22]  Anton Nijholt,et al.  Why conversational agents should catch the eye , 2000, CHI Extended Abstracts.

[23]  Matthew Stone,et al.  An anthropometric face model using variational techniques , 1998, SIGGRAPH.

[24]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[25]  Alex Pentland,et al.  Facial expression recognition using a dynamic model and motion energy , 1995, Proceedings of IEEE International Conference on Computer Vision.

[26]  T. Warabi,et al.  The reaction time of eye-head coordination in man , 1977, Neuroscience Letters.

[27]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  A. Kendon.  Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[29]  J. Cassell,et al.  Turn taking vs. Discourse Structure: How Best to Model Multimodal Conversation , 1998 .