Multimedia group and inter-stream synchronization techniques: A comparative study

This paper presents the most comprehensive analysis and comparison of the most-known multimedia group and inter-stream synchronization approaches. Several types of multimedia synchronization are identified but only inter-stream and group synchronization algorithms are considered. This is the first survey including group synchronization techniques. A classification of the main synchronization techniques included in most of the analyzed algorithms complements the paper. Finally, a table is presented summarizing the main characteristics of each analyzed algorithm according to those techniques and other critical issues.

[1]  Chung-Ming Huang,et al.  Formal Modeling And Design Of Multimedia Synchronization For Interactive Multimedia Presentations In Distributed Environments* , 1998, International 1998 Conference on Consumer Electronics.

[2]  Arif Ghafoor,et al.  Quality-Based Evaluation of Multimedia Synchronization Protocols for Distributed Multimedia Information Systems , 1996, IEEE J. Sel. Areas Commun..

[3]  Craig Partridge,et al.  Flow synchronization protocol , 1994, TNET.

[4]  H.M. Vin,et al.  Designing an on-demand multimedia service , 1992, IEEE Communications Magazine.

[5]  Angelo Furfaro,et al.  Multimedia synchronization based on aspect oriented programming , 2004, Microprocess. Microsystems.

[6]  Yutaka Ishibashi,et al.  Group Synchronization Control in a Remote Haptic Drawing System , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[7]  Changdong Liu,et al.  Adaptive multimedia synchronization in a teleconference system , 1996, Proceedings of ICC/SUPERCOMM '96 - International Conference on Communications.

[8]  Shuji Tasaka,et al.  A distributed control scheme for causality and media synchronization in networked multimedia games , 2002, Proceedings. Eleventh International Conference on Computer Communications and Networks.

[9]  Yutaka Ishibashi,et al.  A synchronization mechanism for continuous media in multimedia communications , 1995, Proceedings of INFOCOM'95.

[10]  Vicky Hardman,et al.  Lip synchronisation for use over the Internet: analysis and implementation , 1996, Proceedings of GLOBECOM'96. 1996 IEEE Global Telecommunications Conference.

[11]  Giovanni Iacovoni,et al.  A Synchronization Control Scheme for Videoconferencing Services , 2007, J. Multim..

[12]  Yutaka Ishibashi,et al.  A group synchronization mechanism for stored media in multicast communications , 1997, Proceedings of INFOCOM '97.

[13]  Yutaka Ishibashi,et al.  Joint Synchronization between Stored Media with Interactive Control and Live Media in Multicast Communications , 2002 .

[14]  K. Ravindran,et al.  Delay Compensation Protocols for Synchronization of Multimedia Data Streams , 1993, IEEE Trans. Knowl. Data Eng..

[15]  Ming-Syan Chen,et al.  An adaptive transmission scheme for audio and video synchronization based on real-time transport protocol , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[16]  Prathima Agrawal,et al.  The Concord algorithm for synchronization of networked multimedia streams , 1995, Proceedings of the International Conference on Multimedia Computing and Systems.

[17]  Aidong Zhang,et al.  A multi-level buffering and feedback scheme for distributed multimedia presentation systems , 1998, Proceedings 7th International Conference on Computer Communications and Networks (Cat. No.98EX226).

[18]  P. Venkat Rangan,et al.  Feedback techniques for continuity and synchronization in multimedia information retrieval , 1995, TOIS.

[19]  Juan Carlos Guerri,et al.  Feedback Flow Control with Hysteresial Techniques for Multimedia Retrievals , 2001, Multimedia Tools and Applications.

[20]  Yutaka Ishibashi,et al.  Adaptive causality and media synchronization control for networked multimedia applications , 2001, ICC 2001. IEEE International Conference on Communications. Conference Record (Cat. No.01CH37240).

[21]  Imad H. Elhajj,et al.  Transparency and synchronization in supermedia enhanced Internet-based teleoperation , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[22]  P. Venkat Rangan,et al.  Performance of Inter-Media Synchronization in Distributed and Heterogeneous Multimedia Systems , 1995, Comput. Networks ISDN Syst..

[23]  Myung J. Lee,et al.  Multipoint Multimedia Teleconference System with Adaptive Synchronization , 1996, IEEE J. Sel. Areas Commun..

[24]  Shuji Tasaka,et al.  Inter-destination synchronization quality in a multicast mobile ad hoc network , 2005, 2005 IEEE 16th International Symposium on Personal, Indoor and Mobile Radio Communications.

[25]  Kurt Rothermel,et al.  An Adaptive Stream Synchronization Protocol , 1995, NOSSDAV.

[26]  Ralf Steinmetz,et al.  A Media Synchronization Survey: Reference Model, Specification, and Case Studies , 1996, IEEE J. Sel. Areas Commun..

[27]  Hiroshi Shigeno,et al.  Media Synchronization Method for Video Hypermedia Application Based on Extended Event Model , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[28]  Yutaka Ishibashi,et al.  Media synchronization between voice and movement of avatars in networked virtual environments , 2004, ACE '04.

[29]  Azzedine Boukerche,et al.  Media Synchronization and QoS Packet Scheduling Algorithms for Wireless Systems , 2005, Mob. Networks Appl..

[30]  A. Ghafoor,et al.  A synchronization framework for communication of pre-orchestrated multimedia information , 1994, IEEE Network.

[31]  Yutaka Ishibashi,et al.  A comparative survey of synchronization algorithms for continuous media in network environments , 2000, Proceedings 25th Annual IEEE Conference on Local Computer Networks. LCN 2000.

[32]  C. Wang,et al.  Interactive multimedia synchronisation in the distributed environment using the formal approach , 2000, IEE Proc. Softw..

[33]  Ernst W. Biersack,et al.  Intra- and inter-stream synchronisation for stored multimedia streams , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[34]  Maria C. Yuang,et al.  A synchronization paradigm with QoS guarantees for multimedia communications , 1999, Seamless Interconnection for Universal Services. Global Telecommunications Conference. GLOBECOM'99. (Cat. No.99CH37042).

[35]  Kurt Rothermel,et al.  An adaptive protocol for synchronizing media streams , 1997, Multimedia Systems.

[36]  Chung-Ming Huang,et al.  Synchronization for Interactive Multimedia Presentations , 1998, IEEE Multim..

[37]  Steven McCanne,et al.  Receiver-driven layered multicast , 1996, SIGCOMM '96.

[38]  Yutaka Ishibashi,et al.  Media Synchronization and Causality Control for Distributed Multimedia Applications , 2001 .

[39]  Nikolaos Laoutaris,et al.  Intrastream synchronization for continuous media streams: a survey of playout schedulers , 2002 .

[40]  Aidong Zhang,et al.  Dynamic playout scheduling algorithms for continuous multimedia streams , 1999, Multimedia Systems.

[41]  Borko Furht,et al.  Evaluation of multimedia synchronization techniques , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[42]  Fang Liu,et al.  An Event Correlation Synchronization Algorithm for MMOG , 2007, Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing (SNPD 2007).

[43]  Chung-Ming Huang,et al.  Achieving multimedia synchronization between live video and live audio streams using QoS controls , 1996, Comput. Commun..

[44]  Yutaka Ishibashi,et al.  Inter-stream synchronization between haptic media and voice in collaborative virtual environments , 2004, MULTIMEDIA '04.

[45]  Hsu-Yang Kung,et al.  PARK: a paused-and-run k-stream multimedia synchronization control scheme , 2000, Proceedings 20th IEEE International Conference on Distributed Computing Systems.

[46]  Chung-Ming Huang,et al.  Synchronization and flow adaptation schemes for reliable multiple-stream transmission in multimedia presentations , 2001, J. Syst. Softw..

[47]  Miguel Correia,et al.  Low-level multimedia synchronization algorithms on broadband networks , 1995, MULTIMEDIA '95.

[48]  Chun-Chuan C. Yang,et al.  Design of the application-level protocol for synchronized multimedia sessions , 2002, 2002 IEEE International Conference on Communications. Conference Proceedings. ICC 2002 (Cat. No.02CH37333).

[49]  Magda El Zarki,et al.  A SYNCHRONIZATION CONTROL SCHEME FOR REAL-TIME STREAMING MULTIMEDIA APPLICATIONS , 2003 .

[50]  Martin Mauve,et al.  Local-lag and timewarp: providing consistency for replicated continuous applications , 2004, IEEE Transactions on Multimedia.

[51]  Arif Ghafoor,et al.  A synchronization and communication model for distributed multimedia objects , 1993, MULTIMEDIA '93.

[52]  Daniel Köhler,et al.  Multimedia Playout Synchronisation Using Buffer Level Control , 1994, IWACA.

[53]  Shuji Tasaka,et al.  Media Synchronization in Heterogeneous Networks: Stored Media Case , 1998 .

[54]  Rajendra Yavatkar.  MCP: a protocol for coordination and temporal synchronization in multimedia collaborative applications , 1992, [1992] Proceedings of the 12th International Conference on Distributed Computing Systems.

[55]  Nick Cercone,et al.  SAMM: an integrated environment to support multimedia synchronization of pre-orchestrated data , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[56]  Azzedine Boukerche,et al.  An Efficient Synchronization Scheme of Multimedia Streams in Wireless and Mobile Systems , 2002, IEEE Trans. Parallel Distributed Syst..

[57]  F. Boronat,et al.  Analysis and Comparison of Multimedia Inter-stream and Group Synchronisation Algorithms , 2005, IEEE Latin America Transactions.

[58]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[59]  Sang Hyuk Son,et al.  A model for specification and synchronization of data for distributed multimedia applications , 2004, Multimedia Tools and Applications.

[60]  Yutaka Ishibashi,et al.  Group synchronization control over haptic media in a networked real-time game with collaborative work , 2006, NetGames '06.

[61]  P. Venkat Rangan,et al.  Feedback Techniques for Intra-Media Continuity and Inter-Media Synchronization in Distributed Multimedia Systems , 1993, Comput. J..

[62]  Thomas D. C. Little.  A framework for synchronous delivery of time-dependent multimedia data , 2005, Multimedia Systems.

[63]  Julius T. Tou,et al.  Information Systems , 1973, GI Jahrestagung.

[64]  H. Kaneoka,et al.  Effects of group synchoronization control over haptic media in collaborative work , 2004 .

[65]  Azzedine Boukerche,et al.  Synchronization and handoff management schemes for wireless multimedia systems , 2003, Comput. Networks.

[66]  Aidong Zhang,et al.  NetMedia: Streaming Multimedia Presentations in Distributed Environments , 2002, IEEE Multim..

[67]  Milton Chen,et al.  A low-latency lip-synchronized videoconferencing system , 2003, CHI '03.

[68]  Yutaka Ishibashi,et al.  Inter-destination synchronization quality in an integrated wired and wireless network with handover , 2002, Global Telecommunications Conference, 2002. GLOBECOM '02. IEEE.

[69]  Otto Carlos Muniz Bandeira Duarte,et al.  SAMM: an integrated environment to support multimedia synchronization of pre-orchestrated data , 1999 .

[70]  Yutaka Ishibashi,et al.  A group synchronization mechanism for live media in multicast communications , 1997, GLOBECOM 97. IEEE Global Telecommunications Conference. Conference Record.

[71]  Magda El Zarki,et al.  On the Adaptive Delay and Synchronization Control of Video Conferencing over the Internet , 2003 .

[72]  S. Cacciaguerra,et al.  On maintaining interactivity in event delivery synchronization for mirrored game architectures , 2004, IEEE Global Telecommunications Conference Workshops, 2004. GlobeCom Workshops 2004..

[73]  Hussein M. Abdel-Wahab,et al.  Light-weight stream synchronization framework for multimedia collaborative applications , 2000, Proceedings ISCC 2000. Fifth IEEE Symposium on Computers and Communications.

[74]  Ja-Ling Wu,et al.  MultiSync: A Synchronization Model for Multimedia Systems , 1996, IEEE J. Sel. Areas Commun..

[75]  Thomas D. C. Little,et al.  A Temporal Reference Framework for Multimedia Synchronization , 1996, IEEE J. Sel. Areas Commun..

[76]  Sugih Jamin,et al.  An Efficient Synchronization Mechanism for Mirrored Game Architectures , 2002, NetGames '02.

[77]  Klara Nahrstedt,et al.  Lip synchronization within an adaptive VOD system , 1997, Electronic Imaging.

[78]  Jau-Hsiung Huang,et al.  A Multimedia Synchronization Model and Its Implementation in Transport Protocols , 1996, IEEE J. Sel. Areas Commun..

[79]  Klara Nahrstedt,et al.  Lip Synchronization within an Adaptive VOD , 1997 .

[80]  David P. Anderson,et al.  A continuous media I/O server and its synchronization mechanism , 1991, Computer.

[81]  Yutaka Ishibashi,et al.  Group synchronization in networked virtual environments , 2003, IEEE International Conference on Communications, 2003. ICC '03..

[82]  Adrian Court,et al.  A Distributed Architecture for Multiplayer Interactive Applications on the Internet , 1999 .

[83]  P. Venkat Rangan,et al.  Continous Media Synchronization in Distributed Multimedia Systems , 1992, NOSSDAV.

[84]  Myung J. Lee,et al.  Interparticipant synchronization in real-time multimedia conferencing using feedback , 1996, TNET.

[85]  Ying-Hong Wang,et al.  Cooperating intelligent mobile agents mechanism for distributed multimedia synchronization , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[86]  Yutaka Ishibashi,et al.  A Group Synchronization Mechanism for Stored Media and Its Measured Performance in a Heterogeneous Network , 1999 .

[87]  P. Venkat Rangan,et al.  Adaptive feedback techniques for synchronized multimedia retrieval over integrated networks , 1993, TNET.

[88]  P. Venkat Rangan,et al.  Continuity and Synchronization in MPEG , 1996, IEEE J. Sel. Areas Commun..

[89]  Yutaka Ishibashi,et al.  Live media synchronization quality of a retransmission-based error recovery scheme , 2000, 2000 IEEE International Conference on Communications. ICC 2000. Global Convergence Through Communications. Conference Record.

[90]  Liu Fang,et al.  An Event Correlation Synchronization Algorithm for MMOG , 2007 .

[91]  Magda El Zarki,et al.  Adaptive delay and synchronization control for Wi-Fi based AV conferencing , 2004, First International Conference on Quality of Service in Heterogeneous Wired/Wireless Networks.

[92]  Yutaka Ishibashi,et al.  Group synchronization control for haptic media in networked virtual environments , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[93]  Thomas D. C. Little,et al.  An Intermedia Skew Control System for Multimedia Data Presentation , 1992, NOSSDAV.

[94]  SangShin Yoo.  Realization of the synchronization controller for multimedia applications , 1998, IEEE GLOBECOM 1998 (Cat. NO. 98CH36250).

[95]  Yutaka Ishibashi,et al.  A Performance Comparison of Single-Stream and Multi-Stream Approaches to Live Media Synchronization , 1998 .

[96]  Arif Ghafoor,et al.  Media synchronization in multimedia Web using a neuro-fuzzy framework , 2000, IEEE Journal on Selected Areas in Communications.

[97]  Lian Li,et al.  Synchronization of Multimedia Data for a Multimedia News-on-Demand Application , 1996, IEEE J. Sel. Areas Commun..

[98]  Ian F. Akyildiz,et al.  Multimedia Group Synchronization Protocols for Integrated Services Networks , 1996, IEEE J. Sel. Areas Commun..

[99]  ZhangAidong,et al.  Dynamic playout scheduling algorithms for continuous multimedia streams , 1999 .

[100]  Sunilkumar S. Manvi,et al.  An agent based synchronization scheme for multimedia applications , 2006, J. Syst. Softw..

[101]  Ernst W. Biersack,et al.  Synchronized delivery and playout of distributed stored multimedia streams , 1999, Multimedia Systems.

[102]  Rajendra Yavatkar,et al.  Communication support for distributed collaborative applications , 1994, Multimedia Systems.