A Web-based distributed architecture for multi-device adaptation in media applications

Abstract HTML5 is driving a strong trend towards interoperable Web-based applications, enabling a wider range of devices to run this kind of applications. The key challenge of next-generation media applications is to federate cooperative devices to provide multi-device experiences overcoming current second screen solutions within the connected TV industry. There is a gap on the experience of users, since they perceive devices as isolated pieces of applications when they would prefer to have a single experience through multiple devices at the same time. This paper proposes a unified methodology and a common specification over Web Components for the adaptation of a single application, seamlessly running different instances on one or more devices simultaneously, according to the multi-device context of the user and the specific features of the devices. The solution presented in this paper extends current Web standards towards an interoperable architecture and offers broadcasters and media application developers the possibility to easily design applications that will automatically provide a unique consistent experience across the connected devices. The architectural design is targeted to be included in the roadmap of the standards.

[1]  A. T. Veenhuizen,et al.  Immersive second-screen experiences using hybrid media synchronization , 2013 .

[2]  Mikel Zorrilla,et al.  Reaching devices around an HbbTV television , 2014, 2014 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[3]  Evelien D'heer,et al.  Second screen applications and tablet users: constellation, awareness, experience, and interest , 2012, EuroITV.

[4]  Márcio Ferreira Moreno,et al.  Ginga-NCL: Declarative middleware for multimedia IPTV services , 2010, IEEE Communications Magazine.

[5]  Igor G. Olaizola,et al.  Cloud session maintenance to synchronise HbbTV applications and home network devices , 2013, 2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[6]  Pablo César,et al.  Usages of the Secondary Screen in an Interactive Television Environment: Control, Enrich, Share, and Transfer Television Content , 2008, EuroITV.

[7]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[8]  Ana Dominguez,et al.  User interface adaptation for multi-device Web-based media applications , 2015, 2015 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[9]  Christoph Ziegler.  Second screen for HbbTV — Automatic application launch and app-to-app communication enabling novel TV programme related second-screen scenarios , 2013, 2013 IEEE Third International Conference on Consumer Electronics ¿ Berlin (ICCE-Berlin).

[10]  Paolo Vergori,et al.  Accessible user interface support for multi-device ubiquitous applications: architectural modifiability considerations , 2014, Universal Access in the Information Society.

[11]  Ferran Marqués,et al.  The MPEG-4 Book , 2003, J. Electronic Imaging.

[12]  Njål T. Borch,et al.  The media state vector: a unifying concept for multi-device media navigation , 2013, MoVid '13.

[13]  Arjeh M. Cohen,et al.  Synchronized Multimedia Integration Language (SMIL) 2.0 , 1998 .

[14]  L. Claudy.  The broadcast empire strikes back , 2012, IEEE Spectrum.

[15]  John Lyle,et al.  On the challenges of building a web-based ubiquitous application platform , 2012, UbiComp '12.

[16]  Márcio Ferreira Moreno,et al.  Multiple exhibition devices in DTV systems , 2009, MM '09.

[17]  Anind K. Dey,et al.  Proceedings of the 2012 ACM Conference on Ubiquitous Computing , 2012, UBICOMP 2012.

[18]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[19]  Gary Anthes,et al.  HTML5 leads a web revolution , 2012, Commun. ACM.

[20]  Klaus Merkel.  Hybrid broadcast broadband TV, the new way to a comprehensive TV experience , 2011, 2011 14th ITG Conference on Electronic Media Technology.