DANCERS: Delft advanced news retrieval system

In this paper we present a system for automated analysis, classification and indexing of broadcast news programs. The system first analyses the visual and the speech stream of an input news program in order to obtain an initial partitioning of the program into the so-called report segments. The analysis of the visual stream provides the boundaries of the report segments lying at the beginning and the end of each anchorperson shot. This analysis step is performed by applying an existing techniques for anchorperson shot detection. The analysis of the speech stream gives the boundaries of the report segments lying in the middle of each silent interval. Then, the transcribed speech of each of the report segments is matched with the content of a large pre-specified textual topic database. This database covers a large number of topics and can be updated by the user at any time. Fro each topic a vast number of keywords is given, each of which is also assigned a weight that indicates the importance of a keyword for a certain topic. The result of the matching procedure is a list of probable topics per report segment, where for each topic on the list a likelihood is computed based on the number of relevant keywords found in the segment and on the weights of those keywords. The list of topics per segment is then shortened by separating the most probable from least probable topics based on their likelihood. Finally, the likelihood values of the most probable topics are used in the last system module to merge related neighboring segments into reports. The most probable topics serving as the base for the segment-merging procedure are the same time the retrieval indexes for the reports and are used for classifying together all reports in the database that cover one and the same topic.

[1]  Alan Hanjalic,et al.  Semiautomatic news analysis, indexing, and classification system based on topic preselection , 1998, Electronic Imaging.

[2]  Alan Hanjalic,et al.  Template-based detection of anchorperson shots in news programs , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[3]  Borko Furht,et al.  Video and Image Processing in Multimedia Systems , 1995 .

[4]  Qian Huang,et al.  Automated semantic structure reconstruction and representation generation for broadcast news , 1998, Electronic Imaging.

[5]  Karen Spärck Jones,et al.  Automatic content-based retrieval of broadcast news , 1995, MULTIMEDIA '95.

[6]  Qi Tian,et al.  An automatic news video parsing, indexing and browsing system , 1997, MULTIMEDIA '96.

[7]  Yasuo Ariki,et al.  Extraction of TV news articles based on scene cut detection using DCT clustering , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[8]  Stefan Eickeler,et al.  Content-based video indexing of TV broadcast news using hidden Markov models , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[9]  Stanley Boykin,et al.  Improving broadcast news segmentation processing , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[10]  Liming Chen,et al.  Multi-criteria video segmentation for TV news , 1997, Proceedings of First Signal Processing Society Workshop on Multimedia Signal Processing.

[11]  Ramesh C. Jain,et al.  Knowledge-guided parsing in video databases , 1993, Electronic Imaging.

[12]  Yannis Avrithis,et al.  Broadcast news parsing using visual cues: a robust face detection approach , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).