Proposal of an Information Compilation Method for Massive News Video Data Based on their Time-Series Semantic Structure

Recent increase of digital storage capacity has enabled the creation of large-scale on-line broadcast video archives. In order to make full use of the data in the archive, it is necessary to let a user easily grasp the availability of certain video data and their contents. Considering this problem, we have been investigating efficient and effective retrieval and reusing methodologies of archived video data. The archive used as a test-bed consists of more than 1,000 hours of news video obtained from a Japanese news program during the past six years. This paper first proposes a news topic tracking and structuring method. A structure called the `topic thread structure', is organized so that it should represent the temporal flow of news topics originating from a specified news story. The paper next introduces a browsing and editing interface that enables the user to browse through news stories along the topic thread structure, and also assists the compilation of selected news stories as a customized video summary or a documentary. The method was applied to the archived news video data in order to observe the quality of the topic thread structure and the usability of the prototype interface. As a result, some structures represented the flow of topics quite close to real-world comprehension. In addition, experiments showed that when the structure could be considered meaningful, the interface combined with the structure could drastically reduce the time needed to browse through the archive for news stories related to the user's interest.

[1]  Shin'ichi Satoh,et al.  Mining Large-Scale Broadcast Video Archives Towards Inter-video Structuring , 2004, PCM.

[2]  Shin'ichi Satoh,et al.  trackThem: Exploring a Large-Scale News Video Archive by Tracking Human Relations , 2005, AIRS.

[3]  Mubarak Shah,et al.  Story Segmentation in News Videos Using Visual and Text Cues , 2005, CIVR.

[4]  Shin'ichi Satoh,et al.  Exploiting Topic Thread Structures in a News Video Archive for the Semi-Automatic Generation of Video Summaries , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[5]  Marcel Worring,et al.  MediaMill: exploring news video archives based on learned semantics , 2005, MULTIMEDIA '05.

[6]  David A. Forsyth,et al.  Towards auto-documentary: tracking the evolution of news stories , 2004, MULTIMEDIA '04.

[7]  Chih-Ping Wei,et al.  Tracing the Event Evolution of Terror Attacks from On-Line News , 2006, ISI.

[8]  Naohiko Uramoto,et al.  A Method for Relating Multiple Newspaper Articles by Using Graphs, and Its Application to Webcasting , 1998, COLING-ACL.

[9]  Tobun Dorbin Ng,et al.  Collages as dynamic summaries for news video , 2002, MULTIMEDIA '02.

[10]  Ramesh Nallapati,et al.  Event threading within news topics , 2004, CIKM '04.

[11]  Chong-Wah Ngo,et al.  Threading and autodocumenting news videos: a promising solution to rapidly browse news topics , 2006, IEEE Signal Processing Magazine.

[12]  Laura A. Dabbish,et al.  Simplifying Video Editing with Intelligent Interaction , 2002 .

[13]  Timo Ojala,et al.  Cluster-temporal browsing of large news video databases , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[14]  Michael G. Christel,et al.  Interactive Maps for a Digital Video Library , 2000, IEEE Multim..