Visual Attention and Eye Gaze During Multiparty Conversations with Distractions

Our objective is to develop a computational model to predict visual attention behavior for an embodied conversational agent. During interpersonal interaction, gaze provides signal feedback and directs conversation flow. Simultaneously, in a dynamic environment, gaze also directs attention to peripheral movements. An embodied conversational agent should therefore employ social gaze not only for interpersonal interaction but also to possess human attention attributes so that its eyes and facial expression portray and convey appropriate distraction and engagement behaviors.

[1]  Roel Vertegaal,et al.  Effects of Gaze on Multiparty Mediated Communication , 2000, Graphics Interface.

[2]  A. Mack.  Inattentional Blindness , 2003 .

[3]  Norman I. Badler,et al.  Where to Look? Automating Attending Behaviors of Virtual Human Characters , 1999, AGENTS '99.

[4]  Mel Slater,et al.  The impact of eye gaze on communication using humanoid avatars , 2001, CHI.

[5]  Justine Cassell,et al.  Fully Embodied Conversational Avatars: Making Communicative Behaviors Autonomous , 1999, Autonomous Agents and Multi-Agent Systems.

[6]  Steven B. Most,et al.  What you see is what you set: sustained inattentional blindness and the capture of awareness. , 2005, Psychological review.

[7]  C. Chabris,et al.  Gorillas in Our Midst: Sustained Inattentional Blindness for Dynamic Events , 1999, Perception.

[8]  Candace L. Sidner,et al.  Engagement rules for human-robot collaborative interactions , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[9]  Norman I. Badler,et al.  Where to look? automating certain visual attending behaviors of human characters , 1999 .

[10]  Norman I. Badler,et al.  Do You See What Eyes See? Implementing Inattentional Blindness , 2005, IVA.

[11]  John K. Tsotsos,et al.  Attention and Performance in Computational Vision , 2008 .

[12]  A. Kendon.  Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[13]  Tetsunori Kobayashi,et al.  Modeling of conversational strategy for the robot participating in the group conversation , 2001, INTERSPEECH.

[14]  Christopher E. Peters.  Direction of Attention Perception for Conversation Initiation in Virtual Environments , 2005, IVA.

[15]  Norman I. Badler,et al.  Virtual human animation based on movement observation and cognitive behavior models , 1999, Proceedings Computer Animation 1999.

[16]  V. Laxon,et al.  The conservation of number, mother, water and a fried egg chez l'enfant. , 1970, Acta psychologica.

[17]  Kristinn R. Thórisson,et al.  The Power of a Nod and a Glance: Envelope Vs. Emotional Feedback in Animated Conversational Agents , 1999, Appl. Artif. Intell..

[18]  David G. Novick,et al.  Coordinating turn-taking with gaze , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[19]  S. Drucker,et al.  The Role of Eye Gaze in Avatar Mediated Conversational Interfaces , 2000 .

[20]  Norman I. Badler,et al.  Multiple influences on gaze and attention behavior for embodied agents , 2006 .

[21]  Allen Allport,et al.  Visual attention , 1989 .

[22]  Elisabetta Bevacqua,et al.  A Model of Attention and Interest Using Gaze Behavior , 2005, IVA.

[23]  Anton Nijholt,et al.  Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes , 2001, CHI.

[24]  Mel Slater,et al.  Public Speaking in Virtual Reality: Facing an Audience of Avatars , 1999, IEEE Computer Graphics and Applications.

[25]  Norman I. Badler,et al.  Generating Sequence of Eye Fixations Using Decision-theoretic Attention Model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[26]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[27]  N. Badler,et al.  Eyes Alive Eyes Alive Eyes Alive Figure 1: Sample Images of an Animated Face with Eye Movements , 2022 .