An approach for controlling synchronous remote instances of a multimedia presentation

The enjoyment of sharing experiences with remote family and friends about TV shows and other multimedia content depends on how synchronized the users' contents are. Many works propose architectures and algorithms to provide continuous media synchronization to enhance the quality of shared media consumption. However, in some applications, such as interactive multimedia presentations, the content synchronization depends on many factors such as, for instance, user interactions. In these applications, in order to provide a synchronous shared experience, the interactions of one user should not affect only his presentation, but the presentation of all remote users which are engaged in the same activity. In this paper, we propose an approach for engaging remote users in synchronous shared experiences to interactive multimedia presentations. Our approach is based on replicating the interactions of one specific user in all remote presentation instances to keep the presentations synchronized. This means that one master user acts like a pilot that controls not only his local presentation but also the presentations of all remote users. We present some challenges that need to be overcome to implement this approach and, for each challenge, we list some possible solutions and their pros and cons. We also present a proof-of-concept implementation for NCL Documents and illustrate its use with highly-interactive multi-video presentations.

[1]  Fernando Boronat,et al.  The need for inter-destination synchronization for emerging social interactive multimedia applications , 2012, IEEE Communications Magazine.

[2]  Pablo César,et al.  From IPTV to synchronous shared experiences challenges in design: Distributed media synchronization , 2011, Signal Process. Image Commun..

[3]  Maria da Graça Campos Pimentel,et al.  Watch-and-comment as a paradigm toward ubiquitous interactive video editing , 2008, TOMCCAP.

[4]  Dick C. A. Bulterman,et al.  SMIL State: an architecture and implementation for adaptive time-based web applications , 2009, Multimedia Tools and Applications.

[5]  Carlos de Salles Soares Neto,et al.  Eventline: representation of the temporal behavior of multimedia applications , 2012, WebMedia.

[6]  Thomas Ottmann,et al.  The “Authoring on the Fly” system for automated recording and replay of (tele)presentations , 2000, Multimedia Systems.

[7]  Martin Mauve,et al.  Local-lag and timewarp: providing consistency for replicated continuous applications , 2004, IEEE Transactions on Multimedia.

[8]  Miguel Garcia,et al.  Multimedia group and inter-stream synchronization techniques: A comparative study , 2009, Inf. Syst..

[9]  Maria da Graça Campos Pimentel,et al.  Interaction with a Problem Solving Multi Video Lecture: Observing Students from Distance and Traditional Learning Courses , 2014, iJET.

[10]  César A. C. Teixeira,et al.  Multimedia presentation integrating interactive media produced in real time with high performance processing , 2012, WebMedia.

[11]  Thierry Duval,et al.  Architectures and Mechanisms to Maintain efficiently Consistency in Collaborative Virtual Environments , 2010 .

[12]  César A. C. Teixeira,et al.  WebNCL: a web-based presentation machine for multimedia documents , 2012, WebMedia.

[13]  Philipp Slusallek,et al.  Extending X3D for distributed multimedia processing and control , 2009, Web3D '09.

[14]  Maria da Graça Campos Pimentel,et al.  Prototyping Applications to Document Human Experiences , 2007, IEEE Pervasive Computing.

[15]  Celso A. S. Santos,et al.  An event-based model for interactive live TV shows , 2008, ACM Multimedia.

[16]  Thierry Duval,et al.  Architectures and Mechanisms to efficiently Maintain Consistency in Collaborative Virtual Environments , 2010 .

[17]  Robert E. Kraut,et al.  Watching together: integrating text chat with video , 2007, CHI.

[18]  Antônio Francisco do Prado,et al.  Software product lines for Web 2.0 synchronous collaboration , 2009, WebMedia.

[19]  Rufael Mekuria,et al.  Are we in sync?: synchronization requirements for watching online video together. , 2011, CHI.