Watching and talking: media content as social nexus

New multimedia applications, such as community-created video repositories and tools for synchronous sharing, have revolutionized the ways that media is watched and shared. Effective instrumentation of these applications can enable researchers and system designers to better understand how video is being consumed: that is, how it is being watched, shared, augmented with annotations and otherwise experienced by individuals, by groups, and crowds. In addition to consuming content, however, people also talk about it. Conversational exchanges around video content can take place within applications (e.g., in chat spaces) and/or using separate communication channels (e.g., microblogs). We propose that the actions of these video viewers, with the video object itself and/or with each other around the video object, provide rich data for understanding the semantics and social relevance of various pieces of video content. We illustrate this approach with current research and a novel taxonomy of social multimedia interaction.

[1]  David A. Shamma,et al.  Tweet the debates: understanding community annotation of uncollected sources , 2009, WSM@MM.

[2]  John R. Kender,et al.  Visual memes in social media: tracking real-world news in YouTube videos , 2011, ACM Multimedia.

[3]  David A. Shamma,et al.  Watch what I watch: using community activity to understand content , 2007, MIR '07.

[4]  Nenghai Yu,et al.  Flickr distance , 2008, ACM Multimedia.

[5]  Konstantinos Chorianopoulos,et al.  SocialSkip: pragmatic understanding within web video , 2011, EuroITV '11.

[6]  Amanda Lee Hughes,et al.  "Site-seeing" in disaster: An examination of on-line social convergence , 2008 .

[7]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[8]  Michael S. Bernstein,et al.  Twitinfo: aggregating and visualizing microblogs for event exploration , 2011, CHI.

[9]  Pablo César,et al.  Fragment, tag, enrich, and send: Enhancing social sharing of video , 2009, TOMCCAP.

[10]  Marie-Laure Ryan Narrative across media : the languages of storytelling , 2004 .

[11]  Avery Wang,et al.  The Shazam music recognition service , 2006, CACM.

[12]  David A. Shamma,et al.  Conversational Shadows: Describing Live Media Events Using Short Messages , 2010, ICWSM.

[13]  David A. Shamma,et al.  Viral Actions: Predicting Video View Counts Using Synchronous Sharing Behaviors , 2011, ICWSM.

[14]  James Bennett,et al.  The Netflix Prize , 2007 .

[15]  Mor Naaman,et al.  HT06, tagging paper, taxonomy, Flickr, academic article, to read , 2006, HYPERTEXT '06.

[16]  Alex Pentland,et al.  Honest Signals - How They Shape Our World , 2008 .

[17]  Mor Naaman,et al.  Less talk, more rock: automated organization of community-contributed collections of concert videos , 2009, WWW '09.

[18]  Gang Wang,et al.  It's All About the Data , 2010, Proceedings of the IEEE.

[19]  Munmun De Choudhury,et al.  What makes conversations interesting?: themes, participants and consequences of conversations in online social media , 2009, WWW '09.

[20]  Frank Bentley,et al.  TuVista: meeting the multimedia needs of mobile sports fans , 2009, ACM Multimedia.

[21]  David A. Shamma,et al.  Knowing funny: genre perception and categorization in social video sharing , 2011, CHI.

[22]  Pablo César,et al.  Creating personalized memories from social events: community-based support for multi-camera recordings of school concerts , 2011, ACM Multimedia.

[23]  Mor Naaman,et al.  Generating summaries and visualization for large collections of geo-referenced photographs , 2006, MIR '06.

[24]  Abigail Sellen,et al.  Understanding videowork , 2007, CHI.

[25]  Didier Sornette,et al.  Viral, Quality, and Junk Videos on YouTube: Separating Content from Noise in an Information-Rich Environment , 2008, AAAI Spring Symposium: Social Information Processing.

[26]  David Geerts,et al.  Understanding Social TV: a survey , 2011 .

[27]  Tat-Seng Chua,et al.  NUS-WIDE: a real-world web image database from National University of Singapore , 2009, CIVR '09.

[28]  Pablo Rodriguez,et al.  I tube, you tube, everybody tubes: analyzing the world's largest user generated content video system , 2007, IMC '07.

[29]  Danah Boyd,et al.  Tweeting from the Town Square: Measuring Geographic Local Networks , 2010, ICWSM.

[30]  Peter Brusilovsky,et al.  Social navigation in web lectures , 2006, HYPERTEXT '06.

[31]  David A. Shamma,et al.  Peaks and persistence: modeling the shape of microblog conversations , 2011, CSCW '11.