论文信息 - The TREC VIdeo Retrieval Evaluation (TRECVID): A Case Study and Status Report

The TREC VIdeo Retrieval Evaluation (TRECVID): A Case Study and Status Report

The TREC Video Retrieval Evaluation (TRECVID) is an annual international effort, funded by the US Advanced Research and Development Agency (ARDA) and the National Institute of Standards and Technology (NIST) to promote progress in content-based retrieval from digital video via open, metrics-based evaluation. Now beginning its fourth year, TRECVID aims over time to develop both a better understanding of how systems can effectively accomplish video retrieval and how one can reliably benchmark their performance. This paper is a case study in the development of video retrieval systems and their evaluation as well as a report on the TRECVID status to-date. After an introduction to the evolution of TRECVID over the past 3 years, we report on the most recent evaluation TRECVID 2003 in terms of the 4 tasks (shot boundary determination, high-level feature extraction, story segmentation and classification, search), the data (133 hours of US television news), the measures, the results obtained, and the approaches taken by some of the 24 participating groups.

[1] Sara Shatford,et al. Analyzing the Subject of a Picture: A Theoretical Approach , 1986 .

[2] Ramesh Jain,et al. Storage and Retrieval for Still Image and Video Databases IV , 1996 .

[3] John S. Boreczky,et al. Comparison of video shot boundary detection techniques , 1996, Electronic Imaging.

[4] Ralph M. Ford. Quantitative comparison of shot boundary detection metrics , 1998, Electronic Imaging.

[5] Charles A. Bouman,et al. Storage and Retrieval for Image and Video Databases VII , 1998 .

[6] Stéphane Marchand-Maillet,et al. Towards a Standard Protocol for the Evaluation of Video-to-Shots Segmentation Algorithms , 1999 .

[7] Noel E. O'Connor,et al. Evaluating and combining digital video shot boundary detection algorithms , 2000 .

[8] Gary Marchionini,et al. Open video: A framework for a test collection , 2000, J. Netw. Comput. Appl..

[9] Paul Over,et al. The TREC-2002 Video Track Report , 2002, TREC.

[10] Jean-Luc Gauvain,et al. The LIMSI Broadcast News transcription system , 2002, Speech Commun..

[11] Peter G. B. Enser,et al. Retrieval of Archival Moving Imagery - CBIR Outside the Frame? , 2002, CIVR.

[12] John W. Mateer,et al. Developing effective test sets and metrics for evaluating automated media analysis systems , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).