Towards Multi-Site Collaboration in 3D Tele-Immersive Environments

3D tele-immersion (3DTI) has recently emerged as a new way of video-mediated collaboration across the Internet. Unlike conventional 2D video-conferencing systems, it can immerse remote users into a shared 3D virtual space so that they can interact or collaborate "virtually". However, most existing 3DTI systems can support only two sites of collaboration, due to the huge demand of networking resources and the lack of a simple yet efficient data dissemination model. In this paper, we propose to use a general publish-subscribe model for multi-site 3DTI systems, which efficiently utilizes limited network resources by leveraging user interest. We focus on the overlay construction problem in the publish-subscribe model by exploring a spectrum of heuristic algorithms for data dissemination. With extensive simulation, we identify the advantages of a simple randomized algorithm. We present optimization to further improve the randomized algorithm by exploiting semantic correlation. Experimental results demonstrate that we can achieve an improvement by a factor of five.

[1]  Ruzena Bajcsy,et al.  Learning Physical Activities in Immersive Virtual Environments , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[2]  Ruzena Bajcsy,et al.  Skeleton-Based Data Compression for Multi-camera Tele-Immersion System , 2007, ISVC.

[3]  Ben Y. Zhao,et al.  Bayeux: an architecture for scalable and fault-tolerant wide-area data dissemination , 2001, NOSSDAV '01.

[4]  L. Gharai,et al.  Large Scale Video Conferencing : A Digital Amphitheater , 2002 .

[5]  Milton Chen,et al.  Design of a virtual auditorium , 2001, MULTIMEDIA '01.

[6]  Srinivasan Seshan,et al.  A case for end system multicast , 2002, IEEE J. Sel. Areas Commun..

[7]  Anne-Marie Kermarrec,et al.  The many faces of publish/subscribe , 2003, CSUR.

[8]  Li Fan,et al.  Web caching and Zipf-like distributions: evidence and implications , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[9]  Ketan Mayer-Patel,et al.  Real-time compression for dynamic 3D environments , 2003, MULTIMEDIA '03.

[10]  Kien A. Hua,et al.  ZIGZAG: an efficient peer-to-peer scheme for media streaming , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[11]  Manish Jain,et al.  End-to-end available bandwidth: measurement methodology, dynamics, and relation with TCP throughput , 2002, SIGCOMM 2002.

[12]  Miguel Castro,et al.  SCRIBE: The Design of a Large-Scale Event Notification Infrastructure , 2001, Networked Group Communication.

[13]  Ruzena Bajcsy,et al.  A Framework for Constructing Real-time Immersive Environments for Training Physical Activities , 2006, J. Multim..

[14]  Lixia Zhang,et al.  Host multicast: a framework for delivering multicast to end users , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[15]  Bobby Bhattacharjee,et al.  Scalable application layer multicast , 2002, SIGCOMM 2002.

[16]  Greg Welch,et al.  Remote 3D medical consultation , 2006 .

[17]  Ruzena Bajcsy,et al.  A multi-stream adaptation framework for bandwidth management in 3D tele-immersion , 2006, NOSSDAV '06.

[19]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[20]  Miguel Castro,et al.  SplitStream: high-bandwidth multicast in cooperative environments , 2003, SOSP '03.

[21]  William Yurcik,et al.  Real-time 3D video compression for tele-immersive environments , 2006, Electronic Imaging.

[22]  Indranil Gupta,et al.  Towards Multi-Site Collaboration in 3D Tele-Immersive Environments , 2008, ICDCS.

[23]  Nicolas D. Georganas,et al.  Design of a multi-sender 3D videoconferencing application over an end system multicast protocol , 2003, ACM Multimedia.

[24]  Ruzena Bajcsy,et al.  TEEVE: the next generation architecture for tele-immersive environments , 2005, Seventh IEEE International Symposium on Multimedia (ISM'05).

[25]  Ruzena Bajcsy,et al.  ViewCast: view dissemination and management for multi-party 3d tele-immersive environments , 2007, ACM Multimedia.

[26]  Thomas Malzbender,et al.  Understanding performance in coliseum, an immersive videoconferencing system , 2005, TOMCCAP.

[27]  Bin Wang,et al.  Multicast routing and its QoS extension: problems, algorithms, and protocols , 2000 .

[28]  Thomas Malzbender,et al.  The Coliseum Immersive Teleconferencing System , 2002 .

[29]  Abigail Sellen,et al.  Video-Mediated Communication , 1997 .

[30]  Ruzena Bajcsy,et al.  A Study of Collaborative Dancing in Tele-immersive Environments , 2006, Eighth IEEE International Symposium on Multimedia (ISM'06).

[31]  Ketan Mayer-Patel,et al.  An open architecture for transport-level protocol coordination in distributed multimedia applications , 2007, TOMCCAP.

[32]  Samir Khuller,et al.  Construction of an efficient overlay multicast infrastructure for real-time applications , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[33]  Dinesh C. Verma,et al.  ALMI: An Application Level Multicast Infrastructure , 2001, USITS.

[34]  Alec Wolman,et al.  Measurement and Analysis of a Streaming Media Workload , 2001, USITS.

[35]  Bruce M. Maggs,et al.  An analysis of live streaming workloads on the internet , 2004, IMC '04.