A multi-user framework supporting video-based avatars

In this paper we present our ongoing work in setting up a multi-user framework that supports video texturing on avatars, creating added value for both gaming and collaborative work applications. Limiting the data propagation and bandwidth usage is a key goal when targeting a scalable application that will be deployed on a general-purpose network such as the Internet. We therefore present a number of techniques that can be used in these circumstances, including increased client responsibilities and multicast communications. By making full use of the increased client processing power and bandwidth, we can relieve the server of many of its traditional roles. At the same time, we can target a range of network-enabled devices by handing over control of quality parameters to the individual clients. Through the combination of real-time video distribution and animated avatars, we aim to achieve an increased level of immersion in the virtual world.

[1]  Maarten Wijnants,et al.  Exploiting Proxy-Based Transcoding to Increase the User Quality of Experience in Networked Applications , 2005, First International Workshop on Advanced Architectures and Algorithms for Internet Delivery and Applications (AAA-IDEA'05).

[2]  Thomas A. DeFanti,et al.  Using video to create avators in virtual reality , 1997, SIGGRAPH '97.

[3]  Claudio Zunino,et al.  An accelerated remote graphics architecture for PDAS , 2003, Web3D '03.

[4]  Eike Falk Anderson Real-Time Character Animation for Computer Games , 2001 .

[5]  Nicolas D. Georganas,et al.  Video transcoding gateway for wireless video access , 2003, CCECE 2003 - Canadian Conference on Electrical and Computer Engineering. Toward a Caring and Humane Technology (Cat. No.03CH37436).

[6]  Steve Benford,et al.  MASSIVE: a collaborative virtual environment for teleconferencing , 1995, TCHI.

[7]  V. Rajan A Realistic Video Avatar System for Networked Virtual Environments , 2002 .

[8]  Maarten Wijnants,et al.  Improving the user quality of experience by incorporating intelligent proxies in the network , 2005 .

[9]  Ken Sakamura,et al.  Multimedia Montage—Counterpoint Synthesis of Movies , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[10]  Wim Lamotte,et al.  Voice over IP with JVOIPLIB and JRTPLIB , 2001, Proceedings LCN 2001. 26th Annual IEEE Conference on Local Computer Networks.

[11]  Yao Wang,et al.  Facial feature extraction and tracking in video sequences , 1997, Proceedings of First Signal Processing Society Workshop on Multimedia Signal Processing.

[12]  Michitaka Hirose,et al.  Development of stereo video avatar in networked immersive projection environment , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[13]  ZHANGLi-xia,et al.  A reliable multicast framework for light-weight sessions and application level framing , 1995 .

[14]  Michael Zyda,et al.  NPSNET:A Network Software Architecture for LargeScale Virtual Environments , 1994, Presence: Teleoperators & Virtual Environments.

[15]  Wim Lamotte,et al.  Designing a Virtual Environment for Large Audiences , 2002, ICOIN.

[16]  Zicheng Liu,et al.  Rapid modeling of animated faces from video , 2001, Comput. Animat. Virtual Worlds.

[17]  Thomas A. Funkhouser,et al.  RING: a client-server system for multi-user virtual environments , 1995, I3D '95.

[18]  Wim Lamotte,et al.  Hybrid representations to improve both streaming and rendering of dynamic networked virtual environments , 2004, VRCAI '04.

[19]  Sung-Ju Lee,et al.  Caching strategies in transcoding-enabled proxy systems for streaming media distribution networks , 2004, IEEE Transactions on Multimedia.

[20]  Daniel Thalmann,et al.  A Taxonomy of Networked Virtual Environments , 1999 .

[21]  Wim Lamotte,et al.  Scalable transmission of avatar video streams in virtual environments , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[22]  Manuel Menezes de Oliveira Neto,et al.  Relief texture mapping , 2000, SIGGRAPH.

[23]  Steve Benford,et al.  User embodiment in collaborative virtual environments , 1995, CHI '95.

[24]  Maarten Wijnants,et al.  Bridging the Gap between Fixed and Mobile Access to an Audio/Video-Enabled Large-Scale NVE , 2005, Web Technologies, Applications, and Services.

[25]  Katherine L. Morse,et al.  Interest Management in Large-Scale Distributed Simulations , 1996 .

[26]  Wim Lamotte,et al.  Performance evaluation of client-side video stream quality selection using autonomous avatars , 2004, ACE '04.

[27]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[28]  David C. Brogan,et al.  Diamond Park and Spline: a Social Virtual Reality System with 3d Animation, Spoken Interaction, and Runtime Modiiability , 1996 .

[29]  Emmanuel Frécon,et al.  DIVE: a scaleable network architecture for distributed virtual environments , 1998, Distributed Syst. Eng..

[30]  Steven McCanne,et al.  An application level video gateway , 1995, MULTIMEDIA '95.

[31]  Greg Humphreys,et al.  Chromium: a stream-processing framework for interactive rendering on clusters , 2002, SIGGRAPH.