Gaze Patterns during Face-to-Face Interaction

We present here the analysis of multimodal data gathered during realistic face-to-face interaction of a target speaker with a number of interlocutors. Videos and gaze of both interlocutors were monitored with an experimental setup using coupled cameras and screens equipped with eye trackers. With the aim to understand the functions of gaze in social interaction and to develop a gaze control model for our talking heads we investigate the influence of cognitive state and social role on the observed gaze behaviour.

[1]  Christopher E. Peters,et al.  Attention-driven eye gaze and blinking for virtual humans , 2003, SIGGRAPH '03.

[2]  E. Vatikiotis-Bateson,et al.  Eye movement of perceivers during audiovisualspeech perception , 1998, Perception & psychophysics.

[3]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[4]  Michele A. Basso,et al.  Not looking while leaping: the linkage of blinking and saccadic gaze shifts , 2004, Experimental Brain Research.

[5]  Martine Grice,et al.  The SUS test: A method for the assessment of text-to-speech synthesis intelligibility using Semantically Unpredictable Sentences , 1996, Speech Commun..

[6]  A. Kendon.  Do Gestures Communicate? A Review , 1994 .

[7]  N. Badler,et al.  Eyes Alive Eyes Alive Eyes Alive Figure 1: Sample Images of an Animated Face with Eye Movements , 2022 .

[8]  Charles Antaki.  Research on Language and Social Interaction , 1969 .

[9]  Milton Chen,et al.  Leveraging the asymmetric sensitivity of eye contact for videoconference , 2002, CHI.

[10]  Dare A. Baldwin,et al.  Do children with autism use the speaker's direction of gaze strategy to crack the code of language? , 1997, Child development.

[11]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[12]  Laurent Itti,et al.  Realistic avatar eye and head animation using a neurobiological model of visual attention , 2004, SPIE Optics + Photonics.

[13]  V. Bruce,et al.  Reflexive visual orienting in response to the social attention of others , 1999 .