An Architecture for Dynamic Contextual Personalization of Multimedia Narratives in IoT Environments

The proliferation of shared multimedia narratives on the Internet is due to three main factors: increasing number of narrative producers, availability of narrative-sharing services, and increasing popularization of mobile devices that allow recording, editing, and sharing narratives. These factors characterize the emergence of an environment we call Internet of Narratives. One of the issues that arise with this environment is the cognitive overload experienced by users when consuming narratives. In this context, consuming a narrative means not only choosing from a large number of possibilities, but also how a narrative must be personalized to suit the user profile and the ubiquitous features of presentation environments. Narrative personalization is not restricted to removing, reordering and restructuring narratives, but it also covers configuring presentation environments according to narrative and user profiles. Through Internet of Things devices, narratives can sense the environment context and actuate on it to offer a more immersive and interactive consumption experience. This article proposes a middleware architecture for personalization of multimedia narratives. This architecture considers the ubiquitous characteristics of IoT presentation environment of multimedia narratives and the continuous stream of unstructured information of such environments.

[1]  L. Bringuier Increasing ad personalization with server-side ad insertion , 2016 .

[2]  Klara Nahrstedt,et al.  A Middleware Infrastructure for Active Spaces , 2002, IEEE Pervasive Comput..

[3]  Cu Pham,et al.  Management architecture for heterogeneous IoT devices in home network , 2016, 2016 IEEE 5th Global Conference on Consumer Electronics.

[4]  Klara Nahrstedt,et al.  Introduction to the special section on the 20th anniversary of the ACM international conference on multimedia , 2013, TOMCCAP.

[5]  Philip Davies,et al.  Requirements for an Adaptive Multimedia Presentation System with Contextual Supplemental Support Media , 2009, 2009 First International Conference on Advances in Multimedia.

[6]  Amit Thawani,et al.  Context Aware Personalized Ad Insertion in an Interactive TV Environment , 2004 .

[7]  Kamran Munir,et al.  The use of ontologies for effective knowledge modelling and information retrieval , 2018, Applied Computing and Informatics.

[8]  Peter Brusilovsky,et al.  Adaptive Hypermedia , 2001, User Modeling and User-Adapted Interaction.

[9]  Judith Masthoff,et al.  Adaptive Hypermedia for Personalised TV , 2005 .

[10]  Klara Nahrstedt,et al.  Evolution of Temporal Multimedia Synchronization Principles , 2018, MediaSync, Handbook on Multimedia Synchronization.

[11]  Andrew McParland TV-Anytime - Using All That Extra Data , 2002 .

[12]  Ramesh C. Jain,et al.  {\rm E} - A Generic Event Model for Event-Centric Multimedia Data Management in eChronicle Applications , 2006, 22nd International Conference on Data Engineering Workshops (ICDEW'06).

[13]  Robert Seeliger,et al.  Dynamic ad-insertion and content orchestration workflows through manifest manipulation in HLS and MPEG-DASH , 2017, 2017 IEEE Conference on Communications and Network Security (CNS).

[14]  Yitzhak Birk,et al.  An Adaptive Multimedia-Presentation System , 1995, NGITS.

[15]  Ian P. McCarthy,et al.  Special issue editorial: the what, why and how of mass customization , 2004, Production Planning & Control.

[16]  Matthias Schneider-Hufschmidt,et al.  Adaptive User Interfaces , 1993 .

[17]  Cleiton Garcia,et al.  Context awareness in UbiComp: An IoT oriented distributed architecture , 2015, 2015 IEEE International Conference on Electronics, Circuits, and Systems (ICECS).

[18]  Hossam Afifi,et al.  Personalized TV Service through Employing Context-Awareness in IPTV/IMS Architecture , 2010, FMN.

[19]  Peter Brusilovsky,et al.  Adaptive Technologies for Training and Education: Adaptive Hypermedia for Education and Training , 2012 .

[20]  Klara Nahrstedt,et al.  Evolution of temporal multimedia synchronization principles: A historical viewpoint , 2013, TOMCCAP.

[21]  Philip Davies,et al.  The Anatomy of an Adaptive Multimedia Presentation System (AMPS) , 2011, MMEDIA 2011.

[22]  Andreas M. Kaplan,et al.  Toward a Parsimonious Definition of Traditional and Electronic Mass Customization , 2006 .

[23]  Nicu Sebe,et al.  Personalized multimedia retrieval: the new trend? , 2007, MIR '07.

[24]  Ansgar Scherp,et al.  A component framework for personalized multimedia applications , 2015 .

[25]  Arkady B. Zaslavsky,et al.  Context Aware Computing for The Internet of Things: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[26]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[27]  Marco A. Casanova,et al.  Nested Event Model for Multimedia Narratives , 2013, 2013 IEEE International Symposium on Multimedia.

[28]  Stefan Pham,et al.  Personalized dynamic ad insertion with MPEG DASH , 2016, 2016 Asia Pacific Conference on Multimedia and Broadcasting (APMediaCast).

[29]  Natalia Stash,et al.  GALE: a generic open source extensible adaptation engine , 2013, New Rev. Hypermedia Multim..