Novelty detection in video retrieval: finding new news in TV news stories

Novelty detection is defined as the detection of documents that provide "new" or previously unseen information. "New information" in a search result list is defined as the incremental information found in a document based on what the user has already learned from reviewing previous documents in a given ranked list of documents. It is assumed that, as a user views a list of documents, their information need changes or evolves, and their state of knowledge increases as they gain new information from the documents they see. The automatic detection of "novelty" , or newness, as part of an information retrieval system could greatly improve a searcher’s experience by presenting "documents" in order of how much extra information they add to what is already known, instead of how similar they are to a user’s query. This could be particularly useful in applications such as the search of broadcast news and automatic summary generation. There are many different aspects of information management, however, this thesis, presents research into the area of novelty detection within the content based video domain. It explores the benefits of integrating the many multi modal resources associated with video content those of low level feature detection evidences such as colour and edge, automatic concepts detections such as face, commercials, and anchor person, automatic speech recognition transcripts and manually annotated MPEG7 concepts into a novelty detection model. The effectiveness of this novelty detection model is evaluated on a collection of TV new data.

[1]  John R. Smith,et al.  On the detection of semantic concepts at TRECVID , 2004, MULTIMEDIA '04.

[2]  James Allan,et al.  Retrieval and novelty detection at the sentence level , 2003, SIGIR.

[3]  Rong Yan,et al.  Learning query-class dependent weights in automatic video retrieval , 2004, MULTIMEDIA '04.

[4]  James Allan,et al.  Temporal summaries of new topics , 2001, SIGIR '01.

[5]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[6]  Mark D. Smucker,et al.  UMass at TREC 2004: Notebook , 2004 .

[7]  Alan F. Smeaton,et al.  Dublin City University Video Track Experiments for TREC 2002 , 2001, TREC.

[8]  Sara Shatford,et al.  Analyzing the Subject of a Picture: A Theoretical Approach , 1986 .

[9]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Alan F. Smeaton,et al.  The Físchlár-News-Stories System: Personalised Access to an Archive of TV News , 2004, RIAO.

[11]  Paul Over,et al.  TRECVID 2004 - An Overview , 2004, TRECVID.

[12]  Paul Over,et al.  TRECVID: Benchmarking the Effectivenss of Information Retrieval Tasks on Digital Video , 2003, CIVR.

[13]  Bo Xu,et al.  NLPR at TREC 2003: Novelty and Robust , 2003, TREC.

[14]  Alan F. Smeaton,et al.  Design, implementation and testing of an interactive video retrieval system , 2003, MIR '03.

[15]  Jade Goldstein-Stewart,et al.  The use of MMR, diversity-based reranking for reordering documents and producing summaries , 1998, SIGIR '98.

[16]  Stephen E. Robertson,et al.  Okapi at TREC-6 Automatic ad hoc, VLC, routing, filtering and QSDR , 1997, TREC.

[17]  C.-C. Jay Kuo,et al.  Color distribution analysis and quantization for image retrieval , 1996, Electronic Imaging.

[18]  Alan F. Smeaton,et al.  A Comparison of Score, Rank and Probability-Based Fusion Methods for Video Shot Retrieval , 2005, CIVR.

[19]  Yi Zhang,et al.  Novelty and redundancy detection in adaptive filtering , 2002, SIGIR '02.

[20]  C. R. Rao,et al.  Diversity: its measurement, decomposition, apportionment and analysis , 1982 .

[21]  Ching-Yung Lin,et al.  Video Collaborative Annotation Forum: Establishing Ground-Truth Labels on Large Multimedia Datasets , 2003, TRECVID.

[22]  Alan F. Smeaton,et al.  Fischlar: an on-line system for indexing and browsing broadcast television content , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[23]  Koichi Takeda,et al.  Information retrieval on the web , 2000, CSUR.

[24]  Hsin-Hsi Chen,et al.  Approach of Information Retrieval with Reference Corpus to Novelty Detection , 2003, TREC.

[25]  Noel E. O'Connor,et al.  A framework for event detection in field-sports video broadcasts based on SVM generated audio-visual feature model. Case-study: soccer video , 2004 .

[26]  Jean-Luc Gauvain,et al.  The LIMSI Broadcast News transcription system , 2002, Speech Commun..

[27]  Paul Over,et al.  The TREC-2002 Video Track Report , 2002, TREC.

[28]  Hal R. Varian,et al.  Economics and search , 1999, SIGF.

[29]  Alan F. Smeaton,et al.  The Fischlar Digital Video Recording, Analysis and Browsing System , 2000, RIAO.

[30]  Donna K. Harman,et al.  Overview of the TREC 2003 Novelty Track , 2003, TREC.

[31]  Joachim M. Buhmann,et al.  Non-parametric similarity measures for unsupervised texture segmentation and image retrieval , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Djoerd Hiemstra,et al.  Using language models for information retrieval , 2001 .

[33]  Alan F. Smeaton,et al.  Aggregated Feature Retrieval for MPEG-7 , 2003, ECIR.

[34]  Sara Shatford Layne,et al.  Some Issues in the Indexing of Images , 1994, J. Am. Soc. Inf. Sci..

[35]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  John R. Smith,et al.  Semi-automatic, data-driven construction of multimedia ontologies , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[37]  David R. Bull,et al.  Video Retrieval Using Global Features in Keyframes , 2002, TREC.

[38]  Alexander G. Hauptmann,et al.  Towards a Large Scale Concept Ontology for Broadcast Video , 2004, CIVR.

[39]  Tomohiro Takagi,et al.  Meiji University Web, Novelty and Genomic Track Experiments , 2004, TREC.

[40]  Noel E. O'Connor,et al.  User interface design for keyframe-based browsing of digital video , 2001 .

[41]  Peter G. B. Enser.  Pictorial information retrieval , 1995 .