CONTENT-BASED BROWSING IN LARGE NEWS VIDEO DATABASES

In this paper, we have evaluated the effectiveness of novel content-based browsing paradigm in video retrieval and compared it to the traditional model of content-based querying with relevance feedback. The presented model, cluster-temporal browsing, integrates feature clusters and chronological video structure dynamically in a single browsing view. A prototype of the browser has been evaluated in 70 hour news video collection by 17 test users in 24 predefined and highly semantic search topics. The contributions of this paper are: comparison of clustertemporal browser against prevalent content-based query paradigm and evaluation of the effect of various browser parameters such as features and interface configurations in search performance. The main conclusions of the paper are that the cluster-temporal browsing surmounts traditional search paradigm in semantic search topics and that lowlevel visual features do not add to the search performance that is obtained using text search on speech transcripts.

[1]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[2]  Charles A. Bouman,et al.  ViBE: a compressed video database structured for active browsing and search , 2004, IEEE Transactions on Multimedia.

[3]  Wei Xiong,et al.  Query by video clip , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[4]  Timo Ojala,et al.  Cluster-temporal browsing of large news video databases , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[5]  Christopher Martin,et al.  Browsing with dynamic key frame collages in Web-based entertainment video services , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[6]  Jukka Kortelainen,et al.  TRECVID 2004 Experiments at MediaTeam Oulu , 2004, TRECVID.

[7]  Timo Ojala,et al.  Analysing the performance of visual, concept and text features in content-based video retrieval , 2004, MIR '04.

[8]  Jianping Fan,et al.  Hierarchical video summarization for medical data , 2001, IS&T/SPIE Electronic Imaging.

[9]  Jean-Luc Gauvain,et al.  The LIMSI Broadcast News transcription system , 2002, Speech Commun..