PolemicTweet: Video Annotation and Analysis through Tagged Tweets

We present PolemicTweet a system with an encompassing, economic, and engaging approach to video tagging and analysis. Annotating and tagging videos manually is a boring and time-consuming process. Yet, in the last couple of years the audiences of events—such as academic conferences—have begun to produce unexploited metadata in the form of micropost activities. With PolemicTweet we explore the use of tagged microposts for both video annotation and browsing aid. PolemicTweet is a system 1) to crowd source conference video tagging with structured sentiment metadata, 2) to engage audiences in a tagging process, and 3) to visualize these annotations for browsing and analyzing a video. We describe the the system and its components as well as the results from a one-year live deployment in 27 different events.

[1]  C. Allen.  The use of video in organizational studies , 1989, SGCH.

[2]  Mor Naaman,et al.  Diamonds in the rough: Social media visual analytics for journalistic inquiry , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[3]  Michael S. Bernstein,et al.  Crowds in two seconds: enabling realtime crowd-powered interfaces , 2011, UIST.

[4]  Min Chen,et al.  Video visualization , 2003, IEEE Visualization, 2003. VIS 2003..

[5]  Wei-Ying Ma,et al.  Image and Video Retrieval , 2003, Lecture Notes in Computer Science.

[6]  Michael S. Bernstein,et al.  Twitinfo: aggregating and visualizing microblogs for event exploration , 2011, CHI.

[7]  Ruck Thawonmas,et al.  Video summarization via crowdsourcing , 2011, CHI EA '11.

[8]  Benjamin B. Bederson,et al.  Human computation: a survey and taxonomy of a growing field , 2011, CHI.

[9]  Danah Boyd,et al.  Digital backchannels in shared physical spaces: experiences at an academic conference , 2005, CHI EA '05.

[10]  Neal Grandgenett.  Ted: Ideas Worth Spreading , 2012 .

[11]  Yoshinobu Tonomura,et al.  VideoMAP and VideoSpaceIcon: tools for anatomizing video content , 1993, INTERCHI.

[12]  Jane Hunter,et al.  Vannotea: A collaborative video indexing, annotation and discussion system for broadband networks , 2003 .

[13]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[14]  Irfan A. Essa,et al.  Videolyzer: quality analysis of online informational video for bloggers and journalists , 2009, CHI.

[15]  Jun Rekimoto,et al.  Adding another communication channel to reality: an experience with a chat-augmented conference , 1998, CHI Conference Summary.

[16]  Tobias Ruppert,et al.  A radial visualization tool for depicting hierarchically structured video content , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[17]  Gregory D. Abowd,et al.  The Family Video Archive: an annotation and browsing environment for home movies , 2003, MIR '03.

[18]  Alexander G. Hauptmann.  Lessons for the Future from a Decade of Informedia Video Analysis Research , 2005, CIVR.

[19]  Drew Harry,et al.  Backchan.nl: integrating backchannels with physical space , 2008, CHI 2008.

[20]  Min Chen,et al.  Hierarchical Event Selection for Video Storyboards with a Case Study on Snooker Video Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[21]  David A. Shamma,et al.  Characterizing debate performance via aggregated twitter sentiment , 2010, CHI.

[22]  Brendan T. O'Connor,et al.  Cheap and Fast – But is it Good? Evaluating Non-Expert Annotations for Natural Language Tasks , 2008, EMNLP.

[23]  Jeremy Roschelle,et al.  VideoNoter: A productivity tool for video data analysis , 1991 .

[24]  Mark J. Perry,et al.  Amateur vision and recreational orientation:: creating live video together , 2012, CSCW '12.

[25]  Marian G. Williams,et al.  Backchannel: whispering in digital conversation , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[26]  Panagiotis G. Ipeirotis,et al.  Quality management on Amazon Mechanical Turk , 2010, HCOMP '10.

[27]  Jason Baldridge,et al.  Twitter Polarity Classification with Label Propagation over Lexical Links and the Follower Graph , 2011, ULNLP@EMNLP.

[28]  Andy Cockburn,et al.  CEVA: a tool for collaborative video analysis , 1997, GROUP.

[29]  Ben Shneiderman,et al.  Monitoring Academic Conferences: Real-Time Visualization and Retrospective Analysis of Backchannel Conversations , 2012, 2012 International Conference on Social Informatics.

[30]  Tiejun Zhao,et al.  Target-dependent Twitter Sentiment Classification , 2011, ACL.

[31]  W. E. Mackay,et al.  EVA: an experimental video annotator for symbolic analysis of video data , 1989, SGCH.

[32]  François Bry,et al.  Promoting Awareness and Participation in Large Class Lectures: The Digital Backchannel Backstage , 2011 .

[33]  Brian J. McNely.  Backchannel persistence and collaborative meaning-making , 2009, SIGDOC '09.

[34]  M. Sheelagh T. Carpendale,et al.  A Visual Backchannel for Large-Scale Events , 2010, IEEE Transactions on Visualization and Computer Graphics.

[35]  Jean-Daniel Fekete,et al.  User-Supplied Sentiments in Tweets , 2012 .

[36]  William G. Griswold,et al.  Digital backchannels in shared physical spaces: attention, intention and contention , 2004, CSCW.

[37]  Drew Harry,et al.  Backchan.nl: integrating backchannels with physical space , 2008, CHI Extended Abstracts.