Discrimination of media moments and media intervals: sticker-based watch-and-comment annotation

In this paper we discuss the problem of how to discriminate moments of interest on videos or live broadcast shows. The primary contribution is a system which allows users to personalize their programs with previously created media stickers—pieces of content that may be temporarily attached to the original video. We present the system’s architecture and implementation, which offer users operators to transparently annotate videos while watching them. We offered a soccer fan the opportunity to add stickers to the video while watching a live match: the user reported both enjoying and being comfortable using the stickers during the match—relevant results even though the experience was not fully representative.

[1]  Johanna D. Moore,et al.  Proceedings of the Conference on Human Factors in Computing Systems , 1989 .

[2]  Kang Li,et al.  Client-centered multimedia content adaptation , 2009, TOMCCAP.

[3]  Dian Tjondronegoro,et al.  Integrating Highlights for More Complete Sports Video Summarization , 2004 .

[4]  David Brown,et al.  Google TV search: dual-wielding search and discovery in a large-scale product , 2008, UXTV '08.

[5]  Luiz Fernando,et al.  Interactive Television in Brazil: System Software and the Digital Divide , 2006 .

[6]  Pablo César,et al.  Usages of the Secondary Screen in an Interactive Television Environment: Control, Enrich, Share, and Transfer Television Content , 2008, EuroITV.

[7]  Lexing Xie,et al.  Event Mining in Multimedia Streams , 2008, Proceedings of the IEEE.

[8]  Jorge García Duque,et al.  An MHP framework to provide intelligent personalized recommendations about digital TV contents , 2008, Softw. Pract. Exp..

[9]  Aaron Marcus,et al.  Mobile TV: Customizing Content and Experience , 2010, Mobile TV: Customizing Content and Experience.

[10]  Noboru Babaguchi,et al.  Automatic personalized video abstraction for sports videos using metadata , 2008, Multimedia Tools and Applications.

[11]  Henning Schulzrinne,et al.  Real Time Streaming Protocol (RTSP) , 1998, RFC.

[12]  Maria da Graça Campos Pimentel,et al.  Watch-and-Comment as an Approach to Collaboratively Annotate Points of Interest in Video and Interactive-TV Programs , 2010, Mobile TV: Customizing Content and Experience.

[13]  Antônio Francisco do Prado,et al.  End-user live editing of iTV programmes , 2010, Int. J. Adv. Media Commun..

[14]  Maria da Graça Campos Pimentel,et al.  Distributed discrimination of media moments and media intervals: a Watch-and-Comment approach , 2010, SAC '10.

[15]  Maria da Graça Campos Pimentel,et al.  Watch-and-comment as a paradigm toward ubiquitous interactive video editing , 2008, TOMCCAP.

[16]  Rik Van de Walle,et al.  Timing issues in multimedia formats: review of the principles and comparison of existing formats , 2004, IEEE Transactions on Multimedia.

[17]  Tetsuya Takiguchi,et al.  Tagging Video Contents with Positive/Negative Interest Based on User's Facial Expression , 2008, MMM.

[18]  Chun-Chia Lee,et al.  AIMED- A Personalized TV Recommendation System , 2006, EuroITV.

[19]  Gerhard Stoll,et al.  An approach to intelligently crop and scale video for broadcast applications , 2010, SAC '10.

[20]  Loren G. Terveen,et al.  CollaboraTV: making television viewing social again , 2008, UXTV '08.

[21]  Maria da Graça Campos Pimentel,et al.  End-user editing of interactive multimedia documents , 2008, DocEng '08.

[22]  Maria da Graça C. Pimentel,et al.  Collaborative synchronous video annotation via the watch-and-comment paradigm , 2009, EuroITV '09.

[23]  Ravin Balakrishnan,et al.  Fluid interaction techniques for the control and annotation of digital video , 2003, UIST '03.

[24]  Alberto Messina,et al.  Implicit news recommendation based on user interest models and multimodal content analysis , 2010, AIEMPro '10.

[25]  Michael Kai Petersen,et al.  Modeling emotional context from latent semantics , 2008, UXTV '08.

[26]  Dan R. Olsen,et al.  Time warp football , 2009, EuroITV '09.

[27]  Bernard Mérialdo,et al.  Personalization of hyperlinked video in interactive television , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[28]  John Zimmerman,et al.  Who's that actor?: the InfoSip TV agent , 2003, ETP '03.

[29]  Pablo César,et al.  Fragment, tag, enrich, and send: Enhancing social sharing of video , 2009, TOMCCAP.

[30]  César A. C. Teixeira,et al.  Ubiquitous services in home networks offered through digital TV , 2009, SAC '09.

[31]  Yi-Ping Phoebe Chen,et al.  Highlights for more complete sports video summarization , 2004, IEEE MultiMedia.

[32]  Makoto Yamamoto,et al.  Estimating Intervals of Interest During TV Viewing for Automatic Personal Preference Acquisition , 2006, PCM.

[33]  José Juan Pazos-Arias,et al.  ZapTV: Personalized User-Generated Content for Handheld Devices in DVB-H Mobile Networks , 2008, EuroITV.

[34]  Yue Gao,et al.  Clip based video summarization and ranking , 2008, CIVR '08.

[35]  Sarandis Mitropoulos,et al.  A distributed platform for personalized advertising in digital interactive TV environments , 2010, J. Syst. Softw..

[36]  Maria da Graça Campos Pimentel,et al.  Interactive multimedia annotations: enriching and extending content , 2004, DocEng '04.

[37]  Crysta J. Metcalf,et al.  Of social television comes home: a field study of communication choices and practices in tv-based text and voice chat , 2009, CHI.

[38]  Pablo César,et al.  The ambulant annotator: empowering viewer-side enrichment of multimedia content , 2006, DocEng '06.

[39]  Sérgio Donizetti Zorzo,et al.  Recommender TV - A Personalized TV Guide System Compliant with Ginga , 2009, SIGMAP.

[40]  Miguel Costa,et al.  Annotations as multiple perspectives of video content , 2002, MULTIMEDIA '02.

[41]  Arjeh M. Cohen,et al.  Synchronized Multimedia Integration Language (SMIL) 2.0 , 1998 .

[42]  Pablo César,et al.  A model for editing operations on active temporal multimedia documents , 2010, DocEng '10.

[43]  Vicente Ferreira de Lucena,et al.  A home automation proposal built on the Ginga digital TV middleware and the OSGi framework , 2009, IEEE Transactions on Consumer Electronics.

[44]  Steven M. Drucker,et al.  SmartSkip: consumer level browsing and skipping of digital video content , 2002, CHI.

[45]  Chia-Hung Yeh,et al.  Robust Region-of-Interest Determination Based on User Attention Model Through Visual Rhythm Analysis , 2007, 2007 16th International Conference on Computer Communications and Networks.

[46]  Patrick J. Hayes,et al.  Moments and points in an interval‐based temporal logic , 1989, Comput. Intell..

[47]  Rogério Ferreira Rodrigues,et al.  Live editing of hypermedia documents , 2006, DocEng '06.

[48]  Pablo César,et al.  Leveraging user impact: an architecture for secondary screens usage in interactive television , 2009, Multimedia Systems.

[49]  David C. Gibbon,et al.  Brief and high-interest video summary generation: evaluating the AT&T labs rushes summarizations , 2008, TVS '08.

[50]  Rogério Ferreira Rodrigues,et al.  Variable and state handling in NCL , 2010, Multimedia Tools and Applications.

[51]  Marco Pellegrini,et al.  STIMO: STIll and MOving video storyboard for the web scenario , 2009, Multimedia Tools and Applications.

[52]  Tilmann Rabl,et al.  Interactive TV Services on Mobile Devices , 2008, IEEE MultiMedia.

[53]  Pablo César,et al.  Creating and sharing personalized time-based annotations of videos on the web , 2010, DocEng '10.

[54]  Rogério Ferreira Rodrigues,et al.  Ginga-NCL: the declarative environment of the Brazilian digital TV System , 2007, Journal of the Brazilian Computer Society.

[55]  David C. Gibbon,et al.  Content personalization and adaptation for three-screen services , 2008, CIVR '08.