Crowdsourcing the indexing of film and television media

In this paper we describe a project that explores how advances in information technology could be used to make film and television media more accessible to both scholarly and non-scholarly audiences. By indexing, at a detailed level, a range of time-synchronized and non-time-synchronized elements in a test collection of 12 films and 8 television programs, we demonstrate how structured data representing many aspects of media content can be produced in a streamlined manner, and discuss how this work could potentially be augmented with automated indexing to be more efficient. We present examples of how this data can be utilized to produce a variety of tools and artifacts that make film and television media more accessible, and suggest that crowdsourcing could be an effective strategy for accomplishing this work on a larger scale. This research contributes to the growing body of literature exploring how multimedia collections can be made more accessible and useful for a variety of purposes.

[1]  Alan F. Smeaton,et al.  Indexing of Fictional Video Content for Event Detection and Summarisation , 2007, EURASIP J. Image Video Process..

[2]  Peter G. B. Enser,et al.  The evolution of visual information retrieval , 2008, J. Inf. Sci..

[3]  Alan F. Smeaton,et al.  Indexing, browsing, and searching of digital video , 2005, Annu. Rev. Inf. Sci. Technol..

[4]  David Trottier.  The Screenwriter's Bible: A Complete Guide to Writing, Formatting, and Selling Your Script , 1994 .

[5]  Rémi Ronfard.  Reading movies: an integrated DVD player for browsing movies and their scripts , 2004, MULTIMEDIA '04.

[6]  Bertrand Augst,et al.  No Longer a Shot in the Dark: Engineering a Robust Environment for Film Study , 1999, Comput. Humanit..

[7]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Michael G. Christel,et al.  Addressing the challenge of visual information access from digital image and video libraries , 2005, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05).

[9]  Kevin Andreano,et al.  The Missing Link: Content Indexing, User-Created Metadata, and Improving Scholarly Access to Moving Image Archives , 2008 .

[10]  Martin Wattenberg,et al.  Studying cooperation and conflict between authors with history flow visualizations , 2004, CHI.

[11]  Carey Martin.  Scenes of Instruction: The Beginnings of the U.S. Study of Film , 2011 .

[12]  Mubarak Shah,et al.  Semantic classification of movie scenes using finite state machines , 2005 .

[13]  Alan F. Smeaton,et al.  Are Visual Informatics Actually Useful in Practice: A Study in a Film Studies Context , 2009, IVIC.

[14]  Paul Over,et al.  TRECVID: evaluating the effectiveness of information retrieval tasks on digital video , 2004, MULTIMEDIA '04.

[15]  Chris Beer,et al.  Visualizing television archives , 2009 .

[16]  Mubarak Shah,et al.  Detection and representation of scenes in videos , 2005, IEEE Transactions on Multimedia.

[17]  Duncan J. Watts,et al.  Financial incentives and the "performance of crowds" , 2009, HCOMP '09.

[18]  Clay Shirky.  Here Comes Everybody: The Power of Organizing Without Organizations , 2008 .

[19]  Yochai Benkler,et al.  The wealth of networks: how social production transforms markets and freedom , 2006 .