Tsinghua University at TRECVID 2004: Shot Boundary Detection and High-Level Feature Extraction

Our shot boundary detection system mainly consists of three components: fade out/in(FOI)detector, cut(CUT)detector and gradual transition(GT)detector. The key technique of FOI detector is the recognition of monochrome frame. In CUT detector, second order derivative method is applied to get cut candidates,and then flashlight detector and other gradual transition filter module are incorporated to eliminate false positives. In GT detector, short GT and long GT are treated separately, more specifically,twin comparison algorithm for short GT and finite state automaton (FSA) model for long GT. Ten runs are submitted. And the evaluation result shows that our system is among the best. The characteristics of the runs are summarized

[1]  G. Thompson,et al.  The Theory of Committees and Elections. , 1959 .

[2]  Tobun Dorbin Ng,et al.  Informedia at TRECVID 2003 : Analyzing and Searching Broadcast News Video , 2003, TRECVID.

[3]  Stephen E. Robertson,et al.  Okapi at TREC-3 , 1994, TREC.

[4]  Dong Wang,et al.  AP-Based Borda Voting Method for Feature Extraction in TRECVID-2004 , 2005, ECIR.

[5]  Bo Zhang,et al.  Temporal Shot Clustering Analysis for Video Concept Detection , 2005, ECIR.

[6]  Ullas Gargi,et al.  Performance characterization and comparison of video indexing algorithms , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[7]  Rainer Lienhart,et al.  Comparison of automatic shot boundary detection algorithms , 1998, Electronic Imaging.

[8]  Jean-Luc Gauvain,et al.  The LIMSI Broadcast News transcription system , 2002, Speech Commun..

[9]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[10]  LefèvreSébastien,et al.  A review of real-time segmentation of uncompressed video sequences for content-based search and retrieval , 2003 .

[11]  Chong-Wah Ngo,et al.  Recent Advances in Content-Based Video Analysis , 2001, Int. J. Image Graph..

[12]  Samy Bengio,et al.  Torch: a modular machine learning software library , 2002 .

[13]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[14]  Lei Zhang,et al.  A CBIR method based on color-spatial feature , 1999, Proceedings of IEEE. IEEE Region 10 Conference. TENCON 99. 'Multimedia Technology for Asia-Pacific Information Infrastructure' (Cat. No.99CH37030).

[15]  Stephen E. Robertson,et al.  Okapi at TREC-4 , 1995, TREC.

[16]  Nicole Vincent,et al.  A review of real-time segmentation of uncompressed video sequences for content-based search and retrieval , 2003, Real Time Imaging.

[17]  Dong Zhang,et al.  A New Shot Boundary Detection Algorithm , 2001, IEEE Pacific Rim Conference on Multimedia.