A Tool for Replay and Analysis of Gaze-Enhanced Multiparty Sessions Captured in Immersive Collaborative Environments

A desktop tool for replay and analysis of gaze-enhanced multiparty virtual collaborative sessions is described. We linked three CAVETM-like environments, creating a multiparty collaborative virtual space where avatars are animated with 3D gaze as well as head and hand motions in real time. Log files are recorded for subsequent playback and analysis using the proposed software tool. During replaying the user can rotate the viewpoint and navigate in the simulated 3D scene. The playback mechanism relies on multiple distributed log files captured at every site. This structure enables an observer to experience latencies of movement and information transfer for every site as this is important for conversation analysis. Playback uses an event-replay algorithm, modified to allow fast traversal of the scene by selective rendering of nodes, and to simulate fast random access. The toolpsilas analysis module can show each participantpsilas 3D gaze points and areas where gaze has been concentrated.

[1]  Lynn Wilcox,et al.  Room with a Rear View: Meeting Capture in a Multimedia Conference Room , 2000, IEEE Multim..

[2]  P. Subramanian.  Active Vision: The Psychology of Looking and Seeing , 2006 .

[3]  Anthony Steed,et al.  Using Breaks in Presence to Identify Usability Issues , 2005 .

[4]  Roel Vertegaal,et al.  GAZE-2: conveying eye contact in group video conferencing using eye-controlled camera direction , 2003, CHI '03.

[5]  Robin Wolff,et al.  Eye-tracking for avatar eye-gaze and interactional analysis in immersive collaborative virtual environments , 2008, CSCW.

[6]  Anand K. Gramopadhye,et al.  Binocular eye tracking in VR for visual inspection training , 2001, VRST '01.

[7]  Martin Mauve,et al.  Recording and playing back interactive media streams , 2005, IEEE Transactions on Multimedia.

[8]  Robin Wolff,et al.  Communicating Eye Gaze across a Distance without Rooting Participants to the Spot , 2008, 2008 12th IEEE/ACM International Symposium on Distributed Simulation and Real-Time Applications.

[9]  Azzedine Boukerche,et al.  A novel solution for the development of collaborative virtual environment simulations in large scale , 2005, Ninth IEEE International Symposium on Distributed Simulation and Real-Time Applications.

[10]  Maja Matijasevic,et al.  A framework for multiuser distributed virtual environments , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[11]  Norman I. Badler,et al.  Visual Attention and Eye Gaze During Multiparty Conversations with Distractions , 2006, IVA.

[12]  Yong Oock Kim,et al.  Collaborative Surgical Simulation over the Internet , 2001, IEEE Internet Comput..

[13]  Peter T. Kirstein,et al.  The multicast multimedia conference recorder , 1998, Proceedings 7th International Conference on Computer Communications and Networks (Cat. No.98EX226).

[14]  Guang-Zhong Yang,et al.  Eyegaze analysis of displays with combined 2D and 3D views , 2005, VIS 05. IEEE Visualization, 2005..

[15]  Steve Benford,et al.  Applications of temporal links: recording and replaying virtual environments , 2002, Proceedings IEEE Virtual Reality 2002.

[16]  Harvey Sacks,et al.  Lectures on Conversation , 1995 .

[17]  Scott L. Minneman,et al.  A confederation of tools for capturing and accessing collaborative activity , 1995, MULTIMEDIA '95.

[18]  Nicolas D. Georganas,et al.  MPEG-4 based recording and replay of collaborative virtual reality sessions , 2002, Proceedings IEEE Virtual Reality 2002.

[19]  Robert J. K. Jacob,et al.  Evaluation and Analysis of Eye Gaze Interaction , 2001 .

[20]  Emmanuel Frécon,et al.  DIVE: communication architecture and programming model , 2004, IEEE Communications Magazine.

[21]  Benjamin Lok,et al.  IPSViz: An After-Action Review Tool for Human-Virtual Human Experiences , 2008, 2008 IEEE Virtual Reality Conference.

[22]  Azzedine Boukerche,et al.  A Capture and Access Mechanism for Accurate Recording and Playing of 3D Virtual Environment Simulations , 2006, 2006 Tenth IEEE International Symposium on Distributed Simulation and Real-Time Applications.

[23]  Anthony Steed,et al.  An assessment of eye-gaze potential within immersive virtual environments , 2007, TOMCCAP.

[24]  Harvey Sacks,et al.  Lectures on Conversation: Sacks/Lectures on Conversation , 1995 .

[25]  Satoshi Suzuki,et al.  Human skill elucidation based on gaze analysis for dynamic manipulation , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.