Real Time Synchronization of Live Broadcast Streams with User Generated Content and Social Network Streams

This paper describes the work in the FP7 STEER project on augmenting a live broadcast with live user generated content. This user generated content consists of both video content, captured with mobile devices, and social network content, such as Facebook or Twitter messages. To enable multi-source synchronization, all content sources need to time stamp the content using synchronized clocks. For synchronized play out we use a synchronization server to control the output timing of the various content. Using social analytics, we determine the most relevant social network messages to present synchronously with the broadcast. A main part of our future research in the project will focus on determining the optimal timing of such social content with a live broadcast.

[1]  Jimmy J. Lin,et al.  Smoothing techniques for adaptive online language models: topic tracking in tweet streams , 2011, KDD.

[2]  Hila Becker,et al.  Beyond Trending Topics: Real-World Event Identification on Twitter , 2011, ICWSM.

[3]  Stefano Battiston,et al.  A model of a trust-based recommendation system on a social network , 2006, Autonomous Agents and Multi-Agent Systems.

[4]  M. Sheelagh T. Carpendale,et al.  A Visual Backchannel for Large-Scale Events , 2010, IEEE Transactions on Visualization and Computer Graphics.

[5]  Yutaka Ishibashi,et al.  A comparative survey of synchronization algorithms for continuous media in network environments , 2000, Proceedings 25th Annual IEEE Conference on Local Computer Networks. LCN 2000.

[6]  Shahab Ud Din,et al.  Synchronization Techniques in Distributed Multimedia Presentation , 2012 .

[7]  David Hutchison,et al.  STEER: A Social Telemedia Environment for Experimental Research , 2012 .

[8]  Fernando Boronat,et al.  Inter-destination multimedia synchronization: schemes, use cases and standardization , 2012, Multimedia Systems.

[9]  Bernard J. Jansen,et al.  Twitter power: Tweets as electronic word of mouth , 2009, J. Assoc. Inf. Sci. Technol..

[10]  Miguel Garcia,et al.  Multimedia group and inter-stream synchronization techniques: A comparative study , 2009, Inf. Syst..

[11]  Borko Furht,et al.  Evaluation of multimedia synchronization techniques , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[12]  Lourdes Beloqui Yuste.  Interactive Multi-source Media Synchronisation for HbbTV , 2012 .

[13]  Yutaka Matsuo,et al.  Earthquake shakes Twitter users: real-time event detection by social sensors , 2010, WWW '10.

[14]  Pablo César,et al.  Past, present, and future of social TV: A categorization , 2011, 2011 IEEE Consumer Communications and Networking Conference (CCNC).

[15]  M. Osborne,et al.  Bieber no more : First Story Detection using Twitter and Wikipedia , 2012 .

[16]  Sanjeev R. Kulkarni,et al.  Wisdom of the Crowd: Incorporating Social Influence in Recommendation Models , 2011, 2011 IEEE 17th International Conference on Parallel and Distributed Systems.

[17]  Hans Stokking,et al.  RTP Clock Source Signalling , 2014, RFC.

[18]  A. T. Veenhuizen,et al.  Immersive second-screen experiences using hybrid media synchronization , 2013 .

[19]  A. T. Veenhuizen,et al.  Frame accurate media synchronization of heterogeneous media sources in an HBB context , 2012 .

[20]  Mike Thelwall,et al.  Sentiment in Twitter events , 2011, J. Assoc. Inf. Sci. Technol..

[21]  Fernando Boronat,et al.  Standardization of Inter-Destination Media Synchronization , 2012 .

[22]  Darren Gergle,et al.  On the "localness" of user-generated content , 2010, CSCW '10.

[23]  Miles Efron,et al.  Hashtag retrieval in a microblogging environment , 2010, SIGIR.