Gaze and Gestures in Telepresence: multimodality, embodiment, and roles of collaboration

This paper proposes a controlled experiment to further investigate the usefulness of gaze awareness and gesture recognition in the support of collaborative work at a distance. We propose to redesign experiments conducted several years ago with more recent technology that would: a) enable to better study of the integration of communication modalities, b) allow users to freely move while collaborating at a distance and c) avoid asymmetries of communication between collaborators. Author Keywords Deixis, eye-tracking, focus of attention, gesture interfaces, natural interaction.

[1]  Tom Rodden,et al.  Turn it this way: grounding collaborative action with remote gestures , 2007, CHI.

[2]  Abhishek Ranjan,et al.  Dynamic shared visual spaces: experimenting with automatic camera control in a remote repair task , 2007, CHI.

[3]  S. Kita.  Pointing: Where language, culture, and cognition meet , 2003 .

[4]  Hideaki Kuzuoka,et al.  Dual ecologies of robot as communication media: thoughts on coordinating orientations and projectability , 2004, CHI.

[5]  Montse Pardàs,et al.  A Unified Framework for Consistent 2-D/3-D Foreground Object Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[7]  喜多 壮太郎.  Pointing : where language, culture, and cognition meet , 2013 .

[8]  A. Monk,et al.  A Look Is Worth a Thousand Words: Full Gaze Awareness in Video-Mediated Conversation , 2002 .

[9]  H. H. Clark,et al.  Speaking while monitoring addressees for understanding , 2004 .

[10]  Hiroshi Ishii,et al.  ClearBoard: a seamless medium for shared drawing and conversation with eye contact , 1992, CHI.

[11]  Hideaki Kuzuoka,et al.  GestureCam: a video communication system for sympathetic remote collaboration , 1994, CSCW '94.

[12]  Ingo Feldmann,et al.  Towards 3 D-Aware Telepresence : Working on Technologies Behind the Scene , 2010 .

[13]  Hideaki Kuzuoka,et al.  Fractured Ecologies: Creating Environments for Collaboration , 2003, Hum. Comput. Interact..

[14]  Pierre Dillenbourg,et al.  Deixis and gaze in collaborative work at a distance (over a shared map): a computational model to detect misunderstandings , 2008, ETRA.

[15]  S. Greenberg,et al.  The Importance of Awareness for Team Cognition in Distributed Collaboration , 2001 .

[16]  Shumin Zhai,et al.  RealTourist - A Study of Augmenting Human-Human and Human-Computer Dialogue with Eye-Gaze Overlay , 2005, INTERACT.

[17]  Abigail Sellen,et al.  One is not enough: multiple views in a media space , 1993, INTERCHI.

[18]  José Luis Landabaso Díaz.  A unified framework for consistent 2d/3d foreground object detection , 2008 .

[19]  Andrew F. Monk,et al.  Some advantages of video conferencing over high-quality audio conferencing: fluency and awareness of attentional focus , 1998, Int. J. Hum. Comput. Stud..