Design of Immersive Environment for Social Interaction Based on Socio-Spatial Information and the Applications

Spatial information plays an important role in social interaction with people. The ICIE (Immersive Collaborative Interaction Environment) is a platform which can present socio-spatial information, obtain human behavior with noncontact sensors, and have components to interpret socio-spatial information. In this paper, we explain the framework of ICIE and main architectures to capture human behavior and to provide virtual spaces in ICIE. We then discuss socio-spatial interaction using ICIE, and introduce some applications and studies which implement this.

[1]  Simon Meers,et al.  Head-pose tracking with a time-of-flight camera , 2008 .

[2]  Toyoaki Nishida,et al.  Capture and Express Behavior Environment (CEBE) for Realizing Enculturating Human-Agent Interaction , 2010, Culture and Computing.

[3]  Hung-Hsuan Huang,et al.  The design of a generic framework for integrating ECA components , 2008, AAMAS.

[4]  László T. Kóczy,et al.  Virtual Training in Immersive Virtual Environment and its Complexity , 2000 .

[5]  David R. Traum,et al.  Embodied agents for multi-party dialogue in immersive virtual worlds , 2002, AAMAS '02.

[6]  Toyoaki Nishida,et al.  VISIE: A spatially immersive interaction environment using real-time human measurement , 2011, 2011 IEEE International Conference on Granular Computing.

[7]  Oliver Otto,et al.  Constructing a Gazebo: Supporting Teamwork in a Tightly Coupled, Distributed Task in Virtual Reality , 2003, Presence: Teleoperators & Virtual Environments.

[8]  Phoebe Sengers,et al.  Traces Embodied Immersive Interaction with Semi-Autonomous Avatars , 2001 .

[9]  Michael G. Strintzis,et al.  Robust real-time 3D head pose estimation from range data , 2005, Pattern Recognit..

[10]  Fadi Dornaika,et al.  Fitting 3D face models for tracking and active appearance model training , 2006, Image Vis. Comput..

[11]  Robin Wolff,et al.  Communicating Eye-gaze Across a Distance: Comparing an Eye-gaze enabled Immersive Collaborative Virtual Environment, Aligned Video Conferencing, and Being Together , 2009, 2009 IEEE Virtual Reality Conference.

[12]  Rüdiger Dillmann,et al.  Fusion of 2d and 3d sensor data for articulated body tracking , 2009, Robotics Auton. Syst..

[13]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[14]  Timothy F. Cootes,et al.  Feature Detection and Tracking with Constrained Local Models , 2006, BMVC.

[15]  Sutasinee Thovutikul,et al.  Handling greeting gesture in simulated crowd , 2011, 2011 IEEE International Conference on Granular Computing.

[16]  M. Press.  Presence : teleoperators and virtual environments. , 2014 .