Efficient Tracking of News Topics Based on Chronological Semantic Structures in a Large-Scale News Video Archive

SUMMARY Recent advance in digital storage technology has enabled us to archive a large volume of video data. Thanks to this trend, we have archived more than 1,800 hours of video data from a daily Japanese news show in the last ten years. When considering the effective use of such a large news video archive, we assumed that analysis of its chronological and semantic structure becomes important. We also consider that providing the users with the development of news topics is more important to help their understanding of current affairs, rather than providing a list of relevant news stories as in most of the current news video retrieval systems. Therefore, in this paper, we propose a structuring method for a news video archive, together with an interface that visualizes the structure, so that users could track the development of news topics according to their interest, efficiently. The proposed news video structure, namely the “topic thread structure”, is obtained as a result of an analysis of the chronological and semantic relation between news stories. Meanwhile, the proposed interface, namely “mediaWalker II”, allows users to track the development of news topics along the topic thread structure, and at the same time watch the video footage corresponding to each news story. Analyses on the topic thread structures obtained by applying the proposed method to actual news video footages revealed interesting and comprehensible relations between news topics in the real world. At the same time, analyses on their size quantified the efficiency of tracking a user’s topic-of-interest based on the proposed topic thread structure. We consider this as a first step towards facilitating video authoring by users based on existing contents in a large

[1]  Michael J. Witbrock,et al.  News-on-Demand: An Application of Informedia® Technology , 1995, D Lib Mag..

[2]  Mark T. Maybury,et al.  Broadcast news navigation using story segmentation , 1997, MULTIMEDIA '97.

[3]  Naohiko Uramoto,et al.  A Method for Relating Multiple Newspaper Articles by Using Graphs, and Its Application to Webcasting , 1998, COLING-ACL.

[4]  Michael J. Witbrock,et al.  Story segmentation and detection of commercials in broadcast news video , 1998, Proceedings IEEE International Forum on Research and Technology Advances in Digital Libraries -ADL'98-.

[5]  Michael G. Christel,et al.  Interactive maps for a digital video library , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[6]  Tobun Dorbin Ng,et al.  Collages as dynamic summaries for news video , 2002, MULTIMEDIA '02.

[7]  Jonathan G. Fiscus,et al.  Topic detection and tracking evaluation overview , 2002 .

[8]  James Allan,et al.  Topic detection and tracking: event-based information organization , 2002 .

[9]  Laura A. Dabbish,et al.  Simplifying Video Editing with Intelligent Interaction , 2002 .

[10]  S. Satoh,et al.  Topic-Based Structuring of a Very Large-Scale News Video Corpus , 2003 .

[11]  Shin'ichi Satoh,et al.  Topic-based inter-video structuring of a large-scale news video corpus , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[12]  Ramesh Nallapati,et al.  Event threading within news topics , 2004, CIKM '04.

[13]  James Allan,et al.  Hierarchical Topic Detection in TDT-2004 , 2004 .

[14]  Timo Ojala,et al.  Cluster-temporal browsing of large news video databases , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[15]  Shin'ichi Satoh,et al.  Mining Large-Scale Broadcast Video Archives Towards Inter-video Structuring , 2004, PCM.

[16]  Shih-Fu Chang,et al.  Story boundary detection in large broadcast news video archives: techniques, experience and trends , 2004, MULTIMEDIA '04.

[17]  David A. Forsyth,et al.  Towards auto-documentary: tracking the evolution of news stories , 2004, MULTIMEDIA '04.

[18]  Shin'ichi Satoh,et al.  trackThem: Exploring a Large-Scale News Video Archive by Tracking Human Relations , 2005, AIRS.

[19]  Alan F. Smeaton,et al.  User evaluation of Físchlár-News , 2006, ACM Trans. Inf. Syst..

[20]  Chong-Wah Ngo,et al.  Threading and Autodocumenting News Videos , 2006 .

[21]  Paul Over,et al.  Evaluation campaigns and TRECVid , 2006, MIR '06.

[22]  Chih-Ping Wei,et al.  Tracing the Event Evolution of Terror Attacks from On-Line News , 2006, ISI.

[23]  Hiroshi Murase,et al.  mediaWalker: a video archive explorer based on time-series semantic structure , 2007, ACM Multimedia.

[24]  Lynda Hardman,et al.  Automatic generation of matter-of-opinion video documentaries , 2008, J. Web Semant..

[25]  Hiroshi Murase,et al.  Proposal of an Information Compilation Method for Massive News Video Data Based on their Time-Series Semantic Structure , 2008 .

[26]  Hiroshi Murase,et al.  Labeling News Topic Threads with Wikipedia Entries , 2009, 2009 11th IEEE International Symposium on Multimedia.

[27]  Marcel Worring,et al.  Browsing Video Along Multiple Threads , 2010, IEEE Transactions on Multimedia.

[28]  Peter H. N. de With,et al.  Automatic mashup generation from multiple-camera concert recordings , 2010, ACM Multimedia.

[29]  H. Murase,et al.  Exploiting the Chronological Semantic Structure in a Large-scale Broadcast News Video Archive for its Efficient Exploration , 2010 .