TEEVE: the next generation architecture for tele-immersive environments

Tele-immersive 3D multi-camera room environments are starting to emerge and with them new challenging research questions. One important question is how to organize the large amount of visual data, being captured, processed, transmitted and displayed, and their corresponding resources, over current COTS computing and networking infrastructures so that "everybody" would be able to install and use tele-immersive environments for conferencing and other activities. In this paper, we propose a novel cross-layer control and streaming framework over general purpose delivery infrastructure, called TEEVE (tele-immersive environments for everybody). TEEVE aims for effective and adaptive coordination, synchronization, and soft QoS-enabled delivery of tele-immersive visual streams to remote room(s). The TEEVE experiments between two tele-immersive rooms residing in different institutions more than 2000 miles apart show that we can sustain communication of up to 12 3D video streams with 4/spl sim/5 3D frames per second for each stream, yielding 4/spl sim/5 tele-immersive video rate.

[1]  Thomas Malzbender,et al.  Understanding performance in coliseum, an immersive videoconferencing system , 2005, TOMCCAP.

[2]  Kostas Daniilidis,et al.  Real time trinocular stereo for tele-immersion , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[3]  L. Gharai,et al.  Large Scale Video Conferencing : A Digital Amphitheater , 2002 .

[4]  Scott Larsen,et al.  Transport and Rendering Challenges of Multi-Stream, 3D Tele-Immersion Data , 2003 .

[5]  Oliver Schreer,et al.  A virtual 3D Video-Conference System Providing Semi-Immersive Telepresence: A Real-Time Solution in Hardware and Software , 2001 .

[6]  Jim Kurose,et al.  Multimedia streaming via TCP: an analytic performance study , 2004, SIGMETRICS 2004.

[7]  Shie-Yuan Wang,et al.  TCP trunking: design, implementation and performance , 1999, Proceedings. Seventh International Conference on Network Protocols.

[8]  Milton Chen,et al.  Design of a virtual auditorium , 2001, MULTIMEDIA '01.

[9]  Ketan Mayer-Patel,et al.  Coordinated multi-streaming for 3D tele-immersion , 2004, MULTIMEDIA '04.

[10]  William Yurcik,et al.  Real-time 3D video compression for tele-immersive environments , 2006, Electronic Imaging.

[11]  V. Isler,et al.  Trinocular stereo: a real-time algorithm and its evaluation , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[12]  Lili Wang,et al.  A multi-path routing service for immersive environments , 2004, IEEE International Symposium on Cluster Computing and the Grid, 2004. CCGrid 2004..

[13]  P. Tinnakornsrisuphap.  RATE-ADJUSTMENT ALGORITHM FOR AGGREGATE TCP CONGESTION CONTROL , 2000 .

[14]  Tzi-cker Chiueh,et al.  Aggregate TCP congestion control using multiple network probing , 2000, Proceedings 20th IEEE International Conference on Distributed Computing Systems.

[15]  Ketan Mayer-Patel,et al.  Real-time compression for dynamic 3D environments , 2003, MULTIMEDIA '03.

[16]  Klara Nahrstedt,et al.  A bandwidth management framework for wireless camera array , 2005, NOSSDAV '05.