Second screen event flow synchronization

Interactivity on TV has evolved. First, it was possible just to change volume and channels manually, and then the remote control was created turning easier the interaction with TV. Soon TV programs started to interact with the users, through telephone calls, SMS and others. With the evolution of broadcasters and television technologies it was possible to send data within audio and video TV streams, turning feasible running interactive applications to enhance TV viewers experience with extra content. Now we see the use of new technologies, like audio controls, motion sense and second screen, to improve interaction. This work describes techniques used to synchronize second screen applications with main content presented on TV, and proposes an alternative solution based on multimedia synchronization. The Event Flow Synchronization (EFS), based on the Flow Synchronization Protocol, is presented, describing its main characteristics and how it can be used to provide second screen applications. To verify EFS for second screen concepts, the Sidekick platform is presented, detailing its components and functionalities. Lastly, applications developed with Sidekick are presented.

[1]  Xiaoqing Yu,et al.  An audio fingerprinting system based on spectral energy structure , 2011 .

[2]  David L. Mills,et al.  Internet time synchronization: the network time protocol , 1991, IEEE Trans. Commun..

[3]  Luca Vignaroli,et al.  Personalized newscasts and social networks: a prototype built over a flexible integration model , 2012, WWW.

[4]  P. Waingankar,et al.  Audio-video synchronization , 2011, ICWET.

[5]  Leon Cruickshank,et al.  Making Interactive tv Easier to Use: Interface Design for a Second Screen Approach , 2007 .

[6]  C. Patridge,et al.  Flow synchronization protocol , 1992, [Conference Record] GLOBECOM '92 - Communications for Global Users: IEEE.

[7]  Zhanting Yuan,et al.  Implementation of Real-Time Audio Watermarking Based on DSP , 2009, 2009 Third International Symposium on Intelligent Information Technology Application Workshops.

[8]  Pablo César,et al.  The Evolution of TV Systems, Content, and Users Toward Interactivity , 2009, Found. Trends Hum. Comput. Interact..

[9]  Thomas D. C. Little,et al.  A Temporal Reference Framework for Multimedia Synchronization , 1996, IEEE J. Sel. Areas Commun..

[10]  Tiago Maritan Ugulino de Araújo,et al.  Accessibility as a Service: Augmenting Multimedia Content with Sign Language Video Tracks , 2013, J. Res. Pract. Inf. Technol..

[11]  Nitya Narasimhan,et al.  "Third screen" social bookmarking for TV , 2010 .

[12]  Márcio Ferreira Moreno,et al.  Multiple exhibition devices in DTV systems , 2009, MM '09.

[13]  Nikolaos D. Doulamis,et al.  Connected TV and beyond , 2012, 2012 IEEE Consumer Communications and Networking Conference (CCNC).

[14]  Sascha Disch,et al.  Audio Watermarking using Subband Modulation Spectra , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[15]  Min Liu.  Study of Digital Video Watermarking , 2012, 2012 International Conference on Computer Science and Electronics Engineering.

[16]  Henning Schulzrinne,et al.  Balancing uplink and downlink delay of VoIP traffic in WLANs using Adaptive Priority Control (APC) , 2006, QShine '06.

[17]  Cécile Roisin,et al.  The limsee3 multimedia authoring model , 2006, DocEng '06.

[18]  Art Dahnert.  HawkEyes: An advanced IP Geolocation approach: IP Geolocation using semantic and measurement based techniques , 2011, 2011 Second Worldwide Cybersecurity Summit (WCS).