Open video: A framework for a test collection

The future will bring widespread access to large digital libraries of video. Consequently, a great deal of research is focused on methods of browsing and retrieving digital video. This type of work requires that investigators acquire and digitize video for their studies since the video information retrieval community does not yet have a collection of video for research purposes. There is a clear need for a shared test collection that they can use. This paper provides a framework for such a test collection and describes the Open Video Project that has begun to develop a test collection based on this framework. The proposed test collection is meant to be used to study a wide range of problems, such as tests of algorithms for creating surrogates for video content or interfaces that display result sets from queries. An important challenge in developing such a collection is storing and distributing video objects. This paper is meant to lay out video management issues that may influence distributed storage solutions. More specifically, this paper describes the first phase for creating the test collection, sets guidelines for building the collection, and serves as a basis for discussion to inform subsequent phases and invite research-community involvement.

[1]  Gary Marchionini,et al.  Building an electronic learning community: from design to implementation , 1998, CHI.

[2]  M. Smith,et al.  Video Skimming for Quick Browsing based on Audio and Image Characterization , 1995 .

[3]  Wolfgang Effelsberg,et al.  Video abstracting , 1997, CACM.

[4]  Edward A. Fox,et al.  Characterization of Two New Experimental Collections in Computer and Information Science Containing Textual and Bibliographic Concepts , 1983 .

[5]  Boon-Lock Yeo,et al.  Time-constrained clustering for segmentation of video into story units , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[6]  Alexander G. Hauptmann,et al.  Speech recognition in the Informedia Digital Video Library: uses and limitations , 1995, Proceedings of 7th IEEE International Conference on Tools with Artificial Intelligence.

[7]  Gerard Salton,et al.  Research and Development in Information Retrieval , 1982, Lecture Notes in Computer Science.

[8]  Gary Marchionini,et al.  Information Seeking in Electronic Environments , 1995 .

[9]  Ben Shneiderman,et al.  Visual information seeking: tight coupling of dynamic query filters with starfield displays , 1994, CHI Conference Companion.

[10]  Michael G. Christel,et al.  Multimedia abstractions for a digital video library , 1997, DL '97.

[11]  Ellen M. Voorhees,et al.  The Sixth Text REtrieval Conference (TREC-6) , 2000, Inf. Process. Manag..

[12]  Gary Marchionini,et al.  Content + connectivity => community: digital resources for a learning community , 1997, DL '97.

[13]  John M. Gauch,et al.  The vision digital video library , 1997, Inf. Process. Manag..

[14]  Gary Marchionini,et al.  Key frame preview techniques for video browsing , 1998, DL '98.

[15]  Christos Faloutsos,et al.  VideoTrails: representing and visualizing structure in video sequences , 1997, MULTIMEDIA '97.

[16]  Alexander G. Hauptmann,et al.  Informedia: news-on-demand multimedia information acquisition and retrieval , 1997 .

[17]  K. Sparck Jones,et al.  INFORMATION RETRIEVAL TEST COLLECTIONS , 1976 .

[18]  Gary Marchionini,et al.  Dynamic key frame presentation techniques for augmenting video browsing , 1998, AVI '98.

[19]  Philippe Aigrain,et al.  Medium knowledge-based macro-segmentation of video into sequences , 1997 .

[20]  Douglas W. Oard,et al.  Serving Users in Many Languages: Cross-Language Information Retrieval for Digital Libraries , 1997, D Lib Mag..

[21]  Yihong Gong,et al.  Lessons Learned from Building a Terabyte Digital Video Library , 1999, Computer.

[22]  Paul England,et al.  Comparison of automatic video segmentation algorithms , 1996, Other Conferences.

[23]  Gary Marchionini,et al.  Augmenting Library Services: Toward the Sharium , 1999 .

[24]  Craig Stanfill,et al.  An Information Retrieval Test-bed on the CM-5 , 1993, TREC.

[25]  Takeo Kanade,et al.  Intelligent Access to Digital Video: Informedia Project , 1996, Computer.

[26]  Donna K. Harman,et al.  The DARPA TIPSTER project , 1992, SIGF.

[27]  Tat-Seng Chua,et al.  A video retrieval and sequencing system , 1995, TOIS.

[28]  Gary Marchionini,et al.  Comprehension and Object Recognition Capabilities for Presentations of Simultaneous Video Key Frame Surrogates , 1997, ECDL.

[29]  Michael G. Christel,et al.  Improving Access to a Digital Video Library , 1997, INTERACT.

[30]  P. Cowen,et al.  Manipulating Montage: Effects on Film Comprehension, Recall, Person Perception, and Aesthetic Responses , 1988 .

[31]  Alex Waibel,et al.  TRANSCRIBING MULTILINGUAL BROADCAST NEWS USING HYPOTHESIS DRIVEN LEXICAL ADAPTATION , 1998 .

[32]  Donna K. Harman,et al.  The TREC Conferences , 1997, HIM.

[33]  Karen Sparck Jones A PERFORMANCE YARDSTICK FOR TEST COLLECTIONS , 1975 .

[34]  Osamu Hori,et al.  A shot classification method of selecting effective key-frames for video browsing , 1997, MULTIMEDIA '96.

[35]  Stephen W. Smoliar,et al.  Video parsing, retrieval and browsing: an integrated and content-based solution , 1997, MULTIMEDIA '95.

[36]  Wayne H. Wolf,et al.  Key frame selection by motion analysis , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[37]  Jane Greenberg,et al.  A Quantitative Profile of a Community of Open Source Linux Developers , 1999 .

[38]  Ben Shneiderman,et al.  Visual information seeking: tight coupling of dynamic query filters with starfield displays , 1994, CHI '94.

[39]  Yiqing Liang,et al.  A digital video library on the World Wide Web , 1997, MULTIMEDIA '96.

[40]  Shih-Fu Chang,et al.  Visual information retrieval from large distributed online repositories , 1997, CACM.