TSync: a new synchronization framework for multi-site 3D tele-immersion

Synchronization is a challenge in the multi-site 3D tele-immersion (3DTI) because it is complicated by the coexistence of highly correlated heterogenous streams from multiple sources, and the need for multi-stream resynchronization when user views change. To address the problems, we present TSync: a new multi-tier synchronization framework for 3DTI which can effectively reduce the multi-stream sync skews. Our contributions are focusing on (1) the use of timed synchronization points for multi-stream synchronization; (2) Internet bandwidth estimation based on machine learning; (3) the cooperative frame rate allocation for correlated multi-streams and (4) the resynchronization protocol used when user views change. Experimental results show that TSync can successfully achieve the synchronization of multi-source heterogeneous streams in 3DTI under Internet dynamics.

[1]  Thomas D. C. Little.  A framework for synchronous delivery of time-dependent multimedia data , 2005, Multimedia Systems.

[2]  Siome Goldenstein,et al.  Time warping of audio signals , 1999, 1999 Proceedings Computer Graphics International.

[3]  Benjamin W. Wah,et al.  Automated learning of playout scheduling algorithms for improving perceptual conversational quality in multi-party VoIP , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[4]  Mark Handley,et al.  Datagram Congestion Control Protocol (DCCP) , 2006, RFC.

[5]  Klara Nahrstedt,et al.  Implementing a Distributed Tele-immersive System , 2008, 2008 Tenth IEEE International Symposium on Multimedia.

[6]  Peter Steenkiste,et al.  Evaluation and characterization of available bandwidth probing techniques , 2003, IEEE J. Sel. Areas Commun..

[7]  Borko Furht,et al.  Evaluation of multimedia synchronization techniques , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[8]  BajcsyRuzena,et al.  Enabling multi-party 3D tele-immersive environments with ViewCast , 2010 .

[9]  Ruzena Bajcsy,et al.  A multi-stream adaptation framework for bandwidth management in 3D tele-immersion , 2006, NOSSDAV '06.

[10]  Magda El Zarki,et al.  An adaptive delay and synchronization control scheme for Wi-Fi based audio/video conferencing , 2006, Wirel. Networks.

[11]  Ralf Steinmetz,et al.  Human Perception of Jitter and Media Synchronization , 1996, IEEE J. Sel. Areas Commun..

[12]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[13]  1588-Precise Time Synchronization as the Basis for Real Time Applications in Automation , 2003 .

[14]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.