Who is Looking at Whom? Visualizing Gaze Awareness for Remote Small-Group Conversations

Fig. 1. We present LookAtChat, an online group chat system that takes advantage of eye-tracking technology available with ordinary webcams to visualize eye contacts in group chats. LookAtChat implements and evaluates both 2D directional and 3D perspective layout to inform users with spatial cues. To convey eye contacts in a), b) directional layout renders arrows between video streams, while out-glowing the video window of users who are looking at you. c) Perspective layout transforms video streams to gaze targets, while slightly shaking the video window of users who are looking at you. As a proof-of-concept, LookAtChat explores the potential of using gaze information during online video chat.

[1]  John C. Tang,et al.  Three's company: understanding communication channels in three-way distributed collaboration , 2010, CSCW '10.

[2]  John L. Arnott,et al.  Using spatial cues to improve videoconferencing , 1992, CHI.

[3]  Mark Billinghurst,et al.  A User Study on MR Remote Collaboration Using Live 360 Video , 2018, 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[4]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[5]  Martin Raubal,et al.  A View on the Viewer: Gaze-Adaptive Captions for Videos , 2020, CHI.

[6]  김선경,et al.  1999 , 2000, Les 25 ans de l’OMC: Une rétrospective en photos.

[7]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[8]  Henry Fuchs,et al.  General-purpose telepresence with head-worn optical see-through displays and projector-based lighting , 2013, 2013 IEEE Virtual Reality (VR).

[9]  Kazuhiro Otsuka,et al.  Behavioral Analysis of Kinetic Telepresence for Small Symmetric Group-to-Group Meetings , 2018, IEEE Transactions on Multimedia.

[10]  Tsuhan Chen,et al.  Video conference system and method for providing parallax correction and sense of presence , 1995 .

[11]  Bernd Fröhlich,et al.  Immersive Group-to-Group Telepresence , 2013, IEEE Transactions on Visualization and Computer Graphics.

[12]  Andrew Blake,et al.  Gaze manipulation for one-to-one teleconferencing , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  S. Harrison.  Media Space 20+ Years of Mediated Life , 2009, Computer Supported Cooperative Work.

[14]  Minh N. Do,et al.  Gaze correction for 3D tele-immersive communication system , 2013, IVMSP 2013.

[15]  Mark Billinghurst,et al.  Out and About — Real World Teleconferencing , 2000 .

[16]  Roel Vertegaal,et al.  TeleHuman: effects of 3d perspective on gaze and pose estimation with a life-size cylindrical telepresence pod , 2012, CHI.

[17]  William Buxton,et al.  Telepresence: Integrating Shared Task and Person Spaces , 1992 .

[18]  Christoph Meinel,et al.  Tele-Board: Enabling efficient collaboration in digital design spaces , 2011, Proceedings of the 2011 15th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[19]  James Hays,et al.  WebGazer: Scalable Webcam Eye Tracking Using User Interactions , 2016, IJCAI.

[20]  Nicolas Roussel,et al.  1 € filter: a simple speed-based low-pass filter for noisy input in interactive systems , 2012, CHI.

[21]  Eyal Ofek,et al.  Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment , 2016, CSCW.

[22]  Maurício Sousa,et al.  Adventures in Hologram Space: Exploring the Design Space of Eye-to-eye Volumetric Telepresence , 2019, VRST.

[23]  Roel Vertegaal,et al.  GAZE-2: conveying eye contact in group video conferencing using eye-controlled camera direction , 2003, CHI '03.

[24]  Teerapaun Tanprasert,et al.  Effects of Shared Gaze on Audio- Versus Text-Based Remote Collaborations , 2020, Proc. ACM Hum. Comput. Interact..

[25]  John F. Canny,et al.  Multiview: improving trust in group video conferencing through spatial faithfulness , 2007, CHI.

[26]  Nicolai Marquardt,et al.  GazeConduits: Calibration-Free Cross-Device Collaboration through Gaze and Touch , 2020, CHI.

[27]  Ehud Sharlin,et al.  Interactive two-sided transparent displays: designing for collaboration , 2014, Conference on Designing Interactive Systems.

[28]  William Buxton,et al.  Mediaspace - Meaningspace - Meetingspace , 2009, Media Space 20+ Years of Mediated Life.

[29]  Ruigang Yang,et al.  Eye contact in video conference via fusion of time-of-flight depth sensor and stereo , 2011 .

[30]  Bernd Fröhlich,et al.  Photoportals: shared references in space and time , 2014, CSCW.

[31]  Paul Parsons,et al.  Assessing User Engagement in Information Visualization , 2017, CHI Extended Abstracts.

[32]  Azadeh Forghani,et al.  Sharing Domestic Life through Long-Term Video Connections , 2015, TCHI.

[33]  Charles T. Loop,et al.  Holoportation: Virtual 3D Teleportation in Real-time , 2016, UIST.

[34]  Mark Ashdown,et al.  Combining head tracking and mouse input for a GUI on multiple monitors , 2005, CHI Extended Abstracts.

[35]  M. Lombard,et al.  Measuring Presence: The Temple Presence Inventory , 2009 .

[36]  John F. Canny,et al.  MultiView: spatially faithful group video conferencing , 2005, CHI.

[37]  Junji Yamato,et al.  MM+Space: n x 4 degree-of-freedom kinetic display for recreating multiparty conversation spaces , 2013, ICMI '13.

[38]  Hiroshi Ishii,et al.  Physical telepresence: shape capture and display for embodied, computer-mediated remote collaboration , 2014, UIST.

[39]  W. Keith Edwards,et al.  TwinSpace: an infrastructure for cross-reality team spaces , 2010, UIST.

[40]  Robin Wolff,et al.  Eye-tracking for avatar eye-gaze and interactional analysis in immersive collaborative virtual environments , 2008, CSCW.

[41]  Junji Yamato,et al.  Reconstructing multiparty conversation field by augmenting human head motions via dynamic displays , 2012, CHI EA '12.

[42]  Judith S. Olson,et al.  What mix of video and audio is useful for small groups doing remote real-time design work? , 1995, CHI '95.

[43]  Hiroshi Ishii,et al.  Transparent layered user interfaces: an evaluation of a display design to enhance focused and divided attention , 1995, CHI '95.

[44]  John C. Tang,et al.  Motion and Attention in a Kinetic Videoconferencing Proxy , 2011, INTERACT.

[45]  Joseph A Cafazzo,et al.  Perception of eye contact in video teleconsultation , 2007, Journal of telemedicine and telecare.

[46]  Yanxia Zhang,et al.  Look together: using gaze for assisting co-located collaborative search , 2017, Personal and Ubiquitous Computing.

[47]  Ramin Samadani,et al.  Gaze awareness and interaction support in presentations , 2010, ACM Multimedia.

[48]  Alexandra Papoutsaki,et al.  Eye-Write: Gaze Sharing for Collaborative Writing , 2019, CHI.

[49]  Alan F. Blackwell,et al.  Dasher—a data entry interface using continuous gestures and language models , 2000, UIST '00.

[50]  P. J. Sheppard,et al.  True-view Videoconferencing System Through 3-D Impression of Telepresence , 1999 .

[51]  David M. Grayson,et al.  Are you looking at me? Eye contact and desktop video conferencing , 2003, TCHI.

[52]  Holger Regenbrecht,et al.  Mutual Gaze Support in Videoconferencing Reviewed , 2015, Commun. Assoc. Inf. Syst..

[53]  Kentaro Toyama,et al.  Gaze Awareness for Video-Conferencing: A Software Approach , 2000, IEEE Multim..

[54]  Roel Vertegaal,et al.  The GAZE groupware system: mediating joint attention in multiparty communication and collaboration , 1999, CHI '99.

[55]  Darren Gergle,et al.  An Eye For Design: Gaze Visualizations for Remote Collaborative Work , 2018, CHI.

[56]  Abigail Sellen,et al.  Remote Conversations: The Effects of Mediating Talk With Technology , 1995, Hum. Comput. Interact..

[57]  Hiroshi Ishii,et al.  ClearBoard: a seamless medium for shared drawing and conversation with eye contact , 1992, CHI.

[58]  Zhen Li,et al.  HoloDoc: Enabling Mixed Reality Workspaces that Harness Physical and Digital Content , 2019, CHI.

[59]  Markus H. Gross,et al.  Gaze Correction for Home Video Conferencing , 2012 .

[60]  Pattie Maes,et al.  Your Place and Mine: Designing a Shared VR Experience for Remotely Located Users , 2018, Conference on Designing Interactive Systems.

[61]  Kazuhiro Otsuka.  MMSpace: Kinetically-augmented telepresence for small group-to-group conversations , 2016, 2016 IEEE Virtual Reality (VR).

[62]  A. Monk,et al.  A Look Is Worth a Thousand Words: Full Gaze Awareness in Video-Mediated Conversation , 2002 .

[63]  P. Debevec,et al.  Achieving eye contact in a one-to-many 3D video teleconferencing system , 2009, ACM Trans. Graph..

[64]  Kenton O'Hara,et al.  Blended interaction spaces for distributed team collaboration , 2011, TCHI.

[65]  Martin Schrepp,et al.  Construction of a Benchmark for the User Experience Questionnaire (UEQ) , 2017, Int. J. Interact. Multim. Artif. Intell..