Immersive Teleconferencing System Based on Video-Avatar for Distance Learning

Teleconference is an important means of communication in distance learning courses. Unlike other technologies used in education, the technology that enables virtual conferencing has changed little since it began to be used. Even the transition from analog to digital technology and the adoption of IP technology changed little in the communication characteristics of this media, basically the same of 2D. The project presented here is part of a new field of research, called immersive telecommunication, which aims at increasing the sense of immersion and presence of the participants. For this purpose, a videoconferencing system was developed, which allows presenters to immerse themselves in a 3D virtual environment, through their video-avatar, and be watched remotely in the form of 3D video. This system integrates several subprojects, involving the capture and rendering of a video-avatar, background removal, gesture recognition, interaction design, among others. The aim of this paper is to present the system architecture and an overview of its modules, the key challenges and adopted solutions.

[1]  Romero Tori,et al.  Non-photorealistic 3D video-avatar , 2009, SIGGRAPH '09.

[2]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[3]  Katsushi Ikeuchi,et al.  Microfacet Billboarding , 2002, Rendering Techniques.

[4]  João Luiz Bernardes,et al.  Comprehensive model and gesture recognition with free hands for 3d environments (Modelo abrangente e reconhecimento de gestos com as mãos livres para ambientes 3D) , 2010 .

[5]  Yoshifumi Kitamura,et al.  Effects of avatar's blinking animation on person impressions , 2008, Graphics Interface.

[6]  Holger Regenbrecht,et al.  Social presence in two- and three-dimensional videoconferencing , 2005 .

[7]  Eleni Stroulia,et al.  Virtual worlds - past, present, and future: New directions in social computing , 2009, Decis. Support Syst..

[8]  Ig-Jae Kim,et al.  Toward immersive telecommunication: 3D video avatar with physical interaction , 2005, ICAT '05.

[9]  N. Sheth Hindu Avatara and Christian Incarnation: A Comparison , 2002 .

[10]  F. R. Farmer,et al.  The lessons of Lucasfilm's habitat , 1991 .

[11]  Markus H. Gross,et al.  blue-c API: a multimedia and 3D video enhanced toolkit for collaborative VR and telepresence , 2004, VRCAI '04.

[12]  Claudio Kirner,et al.  Fundamentos e Tecnologia de Realidade Virtual e Aumentada , 2006 .

[13]  Alexandre Nascimento Tomoyose Comparação e classificação de técnicas de estereoscopia para realidade aumentada e jogos. , 2010 .

[14]  Kay M. Stanney,et al.  Virtual environments , 2002 .

[15]  N.I. Badler,et al.  Avatars a/spl grave/ la Snow Crash , 1998, Proceedings Computer Animation '98 (Cat. No.98EX169).

[16]  David B. Kaber,et al.  Telepresence , 1998, Hum. Factors.

[17]  R. Nakamura,et al.  Improving Collision Detection for Real-Time Video Avatar Interaction , 2012 .

[18]  Hirokazu Kato,et al.  3D live: real time captured content for mixed reality , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[19]  Norman I. Badler,et al.  Avatars á la Snow Crash , 1998, CA.

[20]  M. Hirose,et al.  Usage of Video Avatar Technology for Immersive Communication , 2003 .

[21]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[22]  Michitaka Hirose,et al.  Immersive telecommunication using stereo video avatar , 2001, Proceedings IEEE Virtual Reality 2001.

[23]  Larry Johnson,et al.  The 2011 Horizon Report. , 2011 .