ANTS: A Complete System for Automatic News Programme Annotation Based on Multimodal Analysis

This paper describes an integrated system for the acquisition, automatic annotation and Web publication of television broadcast news programmes named ANTS (automatic newscast transcription system). The system consists of several analysis components integrated in a unified architecture. Users have the possibility to access a large daily-growing database of news stories from the main national channels, all identified, categorised and published in a fully automatic way. The system identifies story boundaries, extracts texts from spoken content, classifies stories by subject and links external relevant information coming from the Web. Performances of the system have been evaluated in a real-life scenario, by providing an instance of the system to a panel of professional users inside RAI. The strength of the approach behind ANTS consists in the ability to integrate several heterogeneous analysis components in a performant and ready-for-production environment, capable of elaborating many hours of material per day without significant service drops and with sufficiently good accuracy for industrial employment in large broadcasting facilities.

[1]  Roberto Basili,et al.  RitroveRAI: A Web Application for Semantic Indexing and Hyperlinking of Multimedia News , 2005, SEMWEB.

[2]  Svetha Venkatesh,et al.  Topic transition detection using hierarchical hidden Markov and semi-Markov models , 2005, MULTIMEDIA '05.

[3]  Hugh E. Williams,et al.  RMIT University at TRECVID 2004 , 2004, TRECVID.

[4]  Martin Franz,et al.  Influence of speech recognition errors on topic detection (poster session) , 2000, SIGIR '00.

[5]  Jérôme Gensel,et al.  CLIPS LIS LSR LABRI Experiments in TREC Video Retrieval 2004 , 2004 .

[6]  Omar Javed,et al.  University of Central Florida at TRECVID 2004 , 2003, TRECVID.

[7]  Keiichiro Hoashi,et al.  Shot Boundary Determination on MPEC Compressed Domain and Story Segmentation Experiments for TRECVID 2003 , 2003, TRECVID.

[8]  Shih-Fu Chang,et al.  Story boundary detection in large broadcast news video archives: techniques, experience and trends , 2004, MULTIMEDIA '04.

[9]  Paul Over,et al.  TRECVID 2004 - An Overview , 2004, TRECVID.

[10]  Lawrence Wai-Choong Wong,et al.  ANSES: Summarisation of News Video , 2003, CIVR.

[11]  Paul Deléglise,et al.  The LIUM speech transcription system: a CMU Sphinx III-based system for French broadcast news , 2005, INTERSPEECH.

[12]  Fabio Brugnara,et al.  A system for the segmentation and transcription of Italian Audio News , 2000, RIAO.

[13]  Mario Vento,et al.  Unsupervised News Video Segmentation by Combined Audio-Video Analysis , 2006, MRCS.