MultiView: spatially faithful group video conferencing

MultiView is a new video conferencing system that supports collaboration between remote groups of people. MultiView accomplishes this by being spatially faithful. As a result, MultiView preserves a myriad of nonverbal cues, includ-ing gaze and gesture, in a way that should improve com-munication. Previous systems fail to support many of these cues because a single camera perspective warps spatial char-acteristics in group-to-group meetings. In this paper, we present a formal definition of spatial faithfulness. We then apply a metaphor-based design methodology to help us spec-ify and evaluate MultiView's support of spatial faithfulness. We then present results from a low-level user study to mea-sure MultiView's effectiveness at conveying gaze and ges-ture perception. MultiView is the first practical solution to spatially faithful group-to-group conferencing, one of the most common applications of video conferencing.

[1]  John Short,et al.  The social psychology of telecommunications , 1976 .

[2]  Roel Vertegaal,et al.  Effects of Gaze on Multiparty Mediated Communication , 2000, Graphics Interface.

[3]  Kentaro Toyama,et al.  Manipulation of Video Eye Gaze and Head Orientation for Video Teleconferencing , 1999 .

[4]  Roel Vertegaal,et al.  GAZE-2: conveying eye contact in group video conferencing using eye-controlled camera direction , 2003, CHI '03.

[5]  Darren Gergle,et al.  Effects of four computer-mediated communications channels on trust development , 2002, CHI.

[6]  Armin Grasnick,et al.  Multiviewpoint autostereoscopic dispays from 4D-Vision GmbH , 2002, IS&T/SPIE Electronic Imaging.

[7]  J. Gibson,et al.  Perception of another person's looking behavior. , 1963, The American journal of psychology.

[8]  John Canny,et al.  Effects of Communication Medium on Interpersonal Perceptions: Don't Hang Up on the Telephone Yet , 2001 .

[9]  Yutaka Matsushita,et al.  Multiparty videoconferencing at virtual social distance: MAJIC design , 1994, CSCW '94.

[10]  M. Argyle,et al.  The Effects of Visibility on Interaction in a Dyad , 1968 .

[11]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[12]  A. Kendon.  Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[13]  Lenny Lipton,et al.  A new autostereoscopic display technology : The SynthaGram TM , 2002 .

[14]  Austin Henderson,et al.  Your place or mine? Learning from long-term use of Audio-Video communication , 1996, Computer Supported Cooperative Work (CSCW).

[15]  D I Perrett,et al.  Organization and functions of cells responsive to faces in the temporal cortex. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[16]  Mark R. Stevens,et al.  Methods for Volumetric Reconstruction of Visual Scenes , 2004, International Journal of Computer Vision.

[17]  Milton Chen,et al.  Leveraging the asymmetric sensitivity of eye contact for videoconference , 2002, CHI.

[18]  P. Ekman.  Telling lies: clues to deceit in the marketplace , 1985 .

[19]  John L. Arnott,et al.  Using spatial cues to improve videoconferencing , 1992, CHI.

[20]  Hiroshi Ishii,et al.  ClearBoard: a seamless medium for shared drawing and conversation with eye contact , 1992, CHI.

[21]  DourishPaul,et al.  Your place or mine? Learning from long-term use of audio-video communication , 1996 .

[22]  A. Monk,et al.  A Look Is Worth a Thousand Words: Full Gaze Awareness in Video-Mediated Conversation , 2002 .