Exploiting the Deep-Link Commentsphere to Support Non-Linear Video Access

In this paper, we investigate the usefulness of deep links for improving video search results. Deep links are time-coded comments with which viewers express their reactions to the content at specific time-points of a video that they find noteworthy. The rationale underlying our work is that deep links can open up an interesting new perspective on the relevance of a video, namely focusing on individual video segments, in addition to the existing ones that typically concern a video as a whole. In this perspective, deep-link comments provide non-linear access to videos via their time-codes, which can match alternate dimensions of user needs that extend beyond topical and affective relevance. We explore the different types of deep-link comments and develop a viewer expressive reaction variety (VERV) typology that captures how viewers deep-link on YouTube. We validate this typology through a user study on Amazon Mechanical Turk to show that it is a typology human annotators can agree upon. We then demonstrate, through experiments, that deep-link comments can automatically be classified into VERV categories and show the potential of our proposed usage of deep-link comments for video search through a user study.

[1]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[2]  Martha Larson,et al.  Intent and its discontents: the user at the wheel of the online video search engine , 2012, ACM Multimedia.

[3]  Marcel Worring,et al.  Concept-Based Video Retrieval , 2009, Found. Trends Inf. Retr..

[4]  Martha Larson,et al.  Discovering User Perceptions of Semantic Similarity in Near-duplicate Multimedia Files , 2012, CrowdSearch.

[5]  Kazutoshi Sumiya,et al.  Scene extraction system for video clips using attached comment interval and pointing region , 2010, Multimedia Tools and Applications.

[6]  Ismail Sengör Altingövde,et al.  How useful is social feedback for learning to rank YouTube videos? , 2013, World Wide Web.

[7]  Gary Marchionini,et al.  Exploring users' video relevance criteria - A pilot study , 2005, ASIST.

[8]  Konstantinos Chorianopoulos,et al.  SocialSkip: pragmatic understanding within web video , 2011, EuroITV '11.

[9]  Martha Larson,et al.  How do we deep-link?: leveraging user-contributed time-links for non-linear video access , 2013, MM '13.

[10]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[11]  David McMenemy,et al.  A classification scheme for content analyses of YouTube video comments , 2013, J. Documentation.

[12]  Alan Hanjalic,et al.  Affective video content representation and modeling , 2005, IEEE Transactions on Multimedia.

[13]  David A. Shamma,et al.  Watch what I watch: using community activity to understand content , 2007, MIR '07.

[14]  Justus J. Randolph.  Free-Marginal Multirater Kappa (multirater K[free]): An Alternative to Fleiss' Fixed-Marginal Multirater Kappa. , 2005 .

[15]  Martha Larson,et al.  LikeLines: collecting timecode-level feedback for web videos through user interactions , 2012, ACM Multimedia.

[16]  Benjamin Satzger,et al.  Crowdsourcing tasks to social networks in BPEL4People , 2012, World Wide Web.

[17]  Martha Larson,et al.  Investigating Factors Influencing Crowdsourcing Tasks with High Imaginative Load , 2011 .

[18]  Benno Stein,et al.  Information Retrieval in the Commentsphere , 2012, TIST.

[19]  Ian Witten,et al.  Data Mining , 2000 .

[20]  James Caverlee,et al.  Ranking Comments on the Social Web , 2009, 2009 International Conference on Computational Science and Engineering.

[21]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[22]  Martha Larson,et al.  SocialZap: Catch-up on Interesting Television Fragments Discovered from Social Media , 2014, ICMR.

[23]  Wolfgang Nejdl,et al.  Analyzing and Mining Comments and Comment Ratings on the Social Web , 2014, TWEB.

[24]  Meng Wang,et al.  MSRA-MM 2.0: A Large-Scale Web Multimedia Dataset , 2009, 2009 IEEE International Conference on Data Mining Workshops.

[25]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[26]  Alan Hanjalic,et al.  Automated high-level movie segmentation for advanced video-retrieval systems , 1999, IEEE Trans. Circuits Syst. Video Technol..

[27]  Gordon Rugg,et al.  The sorting techniques: a tutorial paper on card sorts, picture sorts and item sorts , 1997, Expert Syst. J. Knowl. Eng..

[28]  Timothy Baldwin,et al.  langid.py: An Off-the-shelf Language Identification Tool , 2012, ACL.

[29]  Pablo César,et al.  "Let me comment on your video": supporting personalized end-user comments within third-party online videos , 2012, WebMedia.