Remote Temporal Couplers for Multiple Content Synchronization

Watching TV shows changed in both technology (3D, iTV, smartTV, ...) and source (P2P, IPTV, CDN, ...). Also the user can access digital content from diverse sources by using one or more devices for composing his presentation. This content can range from additional media objects to media streams transmitted in broadcast. The challenge is to make the clocks associated with the presentation of content from different sources (Extra Contents -- EC) aligned under one particular clock (the Main Content one -- MC) at each site (User Device -- UD) where they will be presented. In other words, a MC from the same source is presented in different times for users in different locations, and the EC accessed by each UD will be synchronized with the MC being presented at that moment through a local clock that aligns extra and main content. The proposed model allows any content supplier to offer synchronized contents to a MC regardless any explicit synchronization information being provided by the MC provider. Two evaluations were applied to validate the proposal: a frame correlation and an accuracy test. They have shown that the model worked and achieved a fine-grained precision.

[1]  Ralf Steinmetz,et al.  Human Perception of Jitter and Media Synchronization , 1996, IEEE J. Sel. Areas Commun..

[2]  Fabio Casati,et al.  Understanding Mashup Development , 2008, IEEE Internet Computing.

[3]  Mauro Barbieri,et al.  Synchronization of multi-camera video recordings based on audio , 2007, ACM Multimedia.

[4]  Celso A. S. Santos,et al.  Second screen event flow synchronization , 2013, BMSB.

[5]  Michael J. Evans,et al.  Personalization of broadcast programs using synchronized internet content , 2010, 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE).

[6]  Klara Nahrstedt,et al.  Hourglass multimedia content and service composition framework for smart room environments , 2005, Pervasive Mob. Comput..

[7]  Tiago Maritan Ugulino de Araújo,et al.  An approach to generate and embed sign language video tracks into multimedia contents , 2014, Inf. Sci..

[8]  Michael Fink,et al.  Social- and Interactive-Television Applications Based on Real-Time Ambient-Audio Identification , 2006 .

[9]  Klara Nahrstedt,et al.  Evolution of temporal multimedia synchronization principles: A historical viewpoint , 2013, TOMCCAP.

[10]  Belen Ruiz,et al.  Real-time subtitle synchronization in live television programs , 2011, 2011 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[11]  Rani Malhotra Hybrid Broadcast Broadband TV: The Way Forward for Connected TVs , 2013, IEEE Consumer Electronics Magazine.

[12]  Yannick Prié,et al.  Annotation-based video enrichment for blind people: a pilot study on the use of earcons and speech synthesis , 2011, ASSETS.

[13]  Nikolaos D. Doulamis,et al.  Connected TV and beyond , 2012, 2012 IEEE Consumer Communications and Networking Conference (CCNC).

[14]  Fernando Boronat,et al.  Inter-destination multimedia synchronization: schemes, use cases and standardization , 2012, Multimedia Systems.

[15]  Christopher Howson,et al.  Second screen TV synchronization , 2011, 2011 IEEE International Conference on Consumer Electronics -Berlin (ICCE-Berlin).

[16]  Ralf Steinmetz,et al.  A Media Synchronization Survey: Reference Model, Specification, and Case Studies , 1996, IEEE J. Sel. Areas Commun..