Cross-lingual retrieval of identical news by using image and text information

Recently, the importance of archiving news videos has increased. Therefore, for reusing large quantities of accumulated news videos efficiently and effectively, technology for news topic retrival and tracking is necessary. Moreover, in order to understand a certain topic from various viewpoints, the opportunity for viewing news programs from all over the world has increased. Therefore, we focus on identical event detection in various news programs from different countries. However, cross-lingual retrieval using text information is difficult due to the performance of machine translation and moreover, different viewpoints and cultures. In this paper, we propose a cross-lingual retrieval method for detecting identical news topics that exploits image information together with text information. We utilize the existence of near-duplicate video segments as a strong information for the purpose. In an experiment, we verified the effectiveness of making use of the existence of near-duplicate video segments and the possibility of improving retrieval performance by using them.

[1]  Hiroshi Murase,et al.  Genre-Adaptive Near-Duplicate Video Segment Detection , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[2]  Shin'ichi Satoh,et al.  Exploiting Topic Thread Structures in a News Video Archive for the Semi-Automatic Generation of Video Summaries , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[3]  Chong-Wah Ngo,et al.  Fast tracking of near-duplicate keyframes in broadcast domain with transitivity propagation , 2006, MM '06.

[4]  Mubarak Shah,et al.  Story Segmentation in News Videos Using Visual and Text Cues , 2005, CIVR.

[5]  Gerald Schaefer,et al.  Illuminant and device invariant colour using histogram equalisation , 2005, Pattern Recognit..

[6]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.